Apr 02 10:20:01 devstack cinder-volume[72232]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 02 10:20:01 devstack cinder-volume[72232]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 02 10:20:01 devstack cinder-volume[72232]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 02 10:20:02 devstack cinder-volume[72232]: INFO dbcounter [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] Registered counter for database cinder
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_db.sqlalchemy.engines [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72232) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG dbcounter [-] [72232] Writer thread running {{(pid=72232) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 02 10:20:02 devstack cinder-volume[72232]: INFO cinder.rpc [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 02 10:20:02 devstack cinder-volume[72232]: INFO cinder.rpc [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_db.sqlalchemy.engines [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72232) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 02 10:20:02 devstack cinder-volume[72232]: INFO cinder.volume.manager [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] Determined volume DB was empty at startup.
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG cinder.volume.manager [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72232) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 02 10:20:02 devstack cinder-volume[72232]: INFO cinder.volume.manager [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 02 10:20:02 devstack cinder-volume[72232]: WARNING stevedore.named [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 02 10:20:02 devstack cinder-volume[72232]: WARNING castellan.key_manager [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 02 10:20:02 devstack cinder-volume[72232]: WARNING cinder.keymgr.conf_key_mgr [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG cinder.volume.drivers.lvm [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72232) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_concurrency.processutils [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72232) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_concurrency.processutils [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] CMD "cinder-rtstool verify" returned: 0 in 0.258s {{(pid=72232) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_db.sqlalchemy.engines [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72232) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 02 10:20:02 devstack cinder-volume[72232]: INFO cinder.rpc [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 02 10:20:02 devstack cinder-volume[72232]: INFO cinder.rpc [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 02 10:20:02 devstack cinder-volume[72232]: WARNING stevedore.named [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 02 10:20:02 devstack cinder-volume[72232]: WARNING castellan.key_manager [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 02 10:20:02 devstack cinder-volume[72232]: INFO cinder.volume.manager [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_db.sqlalchemy.engines [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72232) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 02 10:20:02 devstack cinder-volume[72232]: INFO oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] Starting 1 workers
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] Started child 72336 {{(pid=72232) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] Full set of CONF: {{(pid=72232) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] ******************************************************************************** {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] Configuration options gathered from: {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 02 10:20:02 devstack cinder-volume[72336]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] ================================================================================ {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] allow_availability_zone_fallback = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] allow_compression_on_image_upload = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] allowed_direct_url_schemes     = [] {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] api_rate_limit                 = True {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] auth_strategy                  = keystone {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] az_cache_duration              = 3600 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_availability_zone      = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_host                   = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_name                   = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_stats_polling_interval = 60 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backup_api_class               = cinder.backup.api.API {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backup_name_template           = backup-%s {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backup_use_same_host           = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backup_use_temp_snapshot       = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] chap_password                  = **** {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] chap_username                  =  {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cinder_internal_tenant_project_id = a4d9611332ab4517b7f068416a38179e {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cinder_internal_tenant_user_id = 2164910458c644d2b907e5d12db97622 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cloned_volume_same_az          = True {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cluster                        = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] compression_format             = gzip {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] compute_api_class              = cinder.compute.nova.API {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] config_dir                     = [] {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] config_source                  = [] {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] control_exchange               = openstack {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] debug                          = True {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] default_availability_zone      = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] default_group_type             = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] default_volume_type            = lvmdriver-1 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] disk_geometry                  = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] driver_client_cert             = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] driver_client_cert_key         = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] driver_data_namespace          = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] driver_ssl_cert_path           = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72336]: INFO cinder.volume.manager [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 02 10:20:02 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] driver_ssl_cert_verify         = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] driver_use_ssl                 = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] enable_force_upload            = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] enable_new_services            = True {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] enable_unsupported_driver      = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] enforce_multipath_for_image_xfer = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] filter_function                = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] glance_api_insecure            = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] glance_api_servers             = ['http://192.168.122.180/image'] {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] glance_api_ssl_compression     = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] glance_ca_certificates_file    = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] glance_catalog_info            = image:glance:publicURL {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] glance_certfile                = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] glance_keyfile                 = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] glance_num_retries             = 3 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] glance_request_timeout         = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] goodness_function              = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] graceful_shutdown_timeout      = 5 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] group_api_class                = cinder.group.api.API {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] host                           = devstack {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] image_compress_on_upload       = True {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] image_conversion_address_space_limit = 1 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] image_conversion_cpu_limit     = 60 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] image_conversion_disable       = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] image_upload_use_cinder_backend = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] image_upload_use_internal_tenant = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] image_volume_cache_enabled     = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] image_volume_cache_max_count   = 0 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] image_volume_cache_max_size_gb = 0 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] init_host_max_objects_retrieval = 0 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] iscsi_target_flags             =  {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] iscsi_write_cache              = on {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] iser_helper                    = tgtadm {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] iser_ip_address                = 192.168.122.180 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] iser_port                      = 3260 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] log_color                      = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] log_config_append              = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] log_dir                        = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] log_file                       = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] log_options                    = True {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] log_rotate_interval            = 1 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] log_rotate_interval_type       = days {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] log_rotation_type              = none {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] max_age                        = 0 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] max_logfile_count              = 30 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] max_logfile_size_mb            = 200 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] max_over_subscription_ratio    = 20.0 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] message_reap_interval          = 86400 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] message_ttl                    = 2592000 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] migration_create_volume_timeout_secs = 300 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] monkey_patch                   = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] monkey_patch_modules           = [] {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] my_ip                          = 192.168.122.180 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] no_snapshot_gb_quota           = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] num_iser_scan_tries            = 3 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] num_shell_tries                = 3 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] num_volume_device_scan_tries   = 3 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] nvmeof_conn_info_version       = 1 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] nvmet_ns_id                    = 10 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] nvmet_port_id                  = 1 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] osapi_max_limit                = 1000 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] osapi_volume_ext_list          = [] {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] osapi_volume_listen_port       = 8776 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] osapi_volume_use_ssl           = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] osapi_volume_workers           = 2 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] per_volume_size_limit          = -1 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] periodic_fuzzy_delay           = 60 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] periodic_interval              = 60 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] public_endpoint                = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] publish_errors                 = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] quota_backup_gigabytes         = 1000 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] quota_backups                  = 10 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] quota_gigabytes                = 1000 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] quota_groups                   = 10 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] quota_snapshots                = 10 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] quota_volumes                  = 10 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] rate_limit_burst               = 0 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] rate_limit_except_level        = CRITICAL {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] rate_limit_interval            = 0 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] reinit_driver_count            = 3 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] replication_device             = **** {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] report_discard_supported       = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] report_interval                = 120 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] reservation_clean_interval     = 86400 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] reservation_expire             = 86400 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] reserved_image_namespaces      = [] {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] reserved_percentage            = 0 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] rpc_response_timeout           = 120 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] run_external_periodic_tasks    = True {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] scst_target_driver             = iscsi {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] scst_target_iqn_name           = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] service_down_time              = 720 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] shell_completion               = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] snapshot_name_template         = snapshot-%s {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] snapshot_same_host             = True {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] split_loggers                  = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] state_path                     = /opt/stack/data/cinder {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] storage_availability_zone      = nova {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] storage_protocol               = iSCSI {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] syslog_log_facility            = LOG_USER {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] target_helper                  = lioadm {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] target_ip_address              = 192.168.122.180 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] target_port                    = 3260 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] target_protocol                = iscsi {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] target_secondary_ip_addresses  = [] {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] trace_flags                    = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] transport_url                  = **** {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] until_refresh                  = 0 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] use_chap_auth                  = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] use_default_quota_class        = True {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] use_journal                    = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] use_json                       = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] use_multipath_for_image_xfer   = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] use_stderr                     = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] use_syslog                     = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] verify_glance_signatures       = enabled {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] volume_api_class               = cinder.volume.api.API {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] volume_backend_name            = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] volume_clear                   = zero {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] volume_clear_ionice            = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] volume_clear_size              = 0 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] volume_copy_bps_limit          = 0 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] volume_dd_blocksize            = 1M {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] volume_name_template           = volume-%s {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] volume_service_inithost_offload = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] volume_usage_audit_period      = month {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] zoning_mode                    = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:20:02 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:02 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_concurrency.disable_process_locking = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.admin_password = **** {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.admin_token = **** {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.admin_user  = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.auth_port   = 35357 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.auth_protocol = https {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.auth_section = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:02 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.auth_type   = password {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.auth_uri    = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.auth_version = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.cache       = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.certfile    = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack sudo[72340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack sudo[72340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.identity_uri = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.include_service_catalog = True {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.insecure    = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.interface   = public {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.keyfile     = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.memcache_password =  {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.memcache_username =  {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.region_name = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.service_type = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.180/identity {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.backend                  = dogpile.cache.null {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.backend_argument         = **** {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.backend_expiration_time  = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.config_prefix            = cache.oslo {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.debug_cache_backend      = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.enable_retry_client      = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.enable_socket_keepalive  = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.enabled                  = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.enforce_fips_mode        = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.expiration_time          = 600 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.hashclient_retry_attempts = 2 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.memcache_dead_retry      = 300 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.memcache_sasl_enabled    = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.password                 = **** {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.proxies                  = [] {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.redis_db                 = 0 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.redis_server             = localhost:6379 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.retry_attempts           = 2 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.retry_delay              = 0.0 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.socket_keepalive_count   = 1 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.socket_keepalive_idle    = 1 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.socket_keepalive_interval = 1 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.socket_timeout           = 1.0 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.tls_allowed_ciphers      = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.tls_cafile               = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.tls_certfile             = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.tls_enabled              = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.tls_keyfile              = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cache.username                 = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] coordination.backend_url       = **** {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] database.asyncio_connection    = **** {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] database.asyncio_slave_connection = **** {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] database.backend               = sqlalchemy {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] database.connection            = **** {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] database.connection_debug      = 0 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] database.connection_parameters =  {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] database.connection_recycle_time = 3600 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] database.connection_trace      = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] database.db_inc_retry_interval = True {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] database.db_max_retries        = 20 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] database.db_max_retry_interval = 10 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] database.db_retry_interval     = 1 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] database.max_overflow          = 50 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] database.max_pool_size         = 5 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] database.max_retries           = 10 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] database.mysql_wsrep_sync_wait = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] database.pool_timeout          = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] database.retry_interval        = 10 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] database.slave_connection      = **** {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] database.sqlite_synchronous    = True {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] database.synchronous_reader    = True {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] database.use_db_reconnect      = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] profiler.connection_string     = messaging:// {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] profiler.enabled               = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] profiler.es_doc_type           = notification {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] profiler.es_scroll_size        = 10000 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] profiler.es_scroll_time        = 2m {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] profiler.filter_error_trace    = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] profiler.hmac_keys             = **** {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] profiler.sentinel_service_name = mymaster {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] profiler.socket_timeout        = 0.1 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] profiler.trace_requests        = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] profiler.trace_sqlalchemy      = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] profiler_jaeger.process_tags   = {} {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] profiler_jaeger.service_name_prefix = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] profiler_otlp.service_name_prefix = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_policy.enforce_new_defaults = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: WARNING oslo_config.cfg [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_policy.enforce_scope      = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_policy.policy_default_rule = default {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] privsep_osbrick.group          = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] privsep_osbrick.helper_command = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] privsep_osbrick.user           = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cinder_sys_admin.group         = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cinder_sys_admin.helper_command = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] cinder_sys_admin.user          = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] service_user.auth_section      = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] service_user.auth_type         = password {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] service_user.cafile            = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] service_user.certfile          = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] service_user.collect_timing    = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] service_user.insecure          = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] service_user.keyfile           = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] service_user.send_service_user_token = True {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] service_user.split_loggers     = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] service_user.timeout           = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] glance.auth_section            = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] glance.auth_type               = password {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] glance.certfile                = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] glance.collect_timing          = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] glance.insecure                = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] glance.keyfile                 = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] glance.region_name             = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] glance.split_loggers           = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] glance.timeout                 = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.backend_availability_zone = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.chap_password = **** {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.chap_username =  {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.disk_geometry = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.driver_client_cert = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.driver_client_cert_key = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.driver_data_namespace = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.driver_use_ssl = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.extra_capabilities = {} {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.filter_function = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.goodness_function = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.iscsi_target_flags =  {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.iscsi_write_cache = on {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.iser_helper   = tgtadm {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.iser_ip_address = 192.168.122.180 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.iser_port     = 3260 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.lvm_share_target = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.lvm_type      = auto {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.num_shell_tries = 3 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.replication_device = **** {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.report_discard_supported = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.reserved_percentage = 0 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.target_helper = tgtadm {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.target_ip_address = 192.168.122.180 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.target_port   = 3260 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.target_protocol = iscsi {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.trace_flags   = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.unique_fqdn_network = True {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.use_chap_auth = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.volume_backend_name = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.volume_clear  = zero {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.volume_clear_ionice = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.volume_clear_size = 0 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_reports.file_event_handler = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_reports.log_dir           = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.backend_host       = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.chap_password      = **** {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.chap_username      = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.disk_geometry      = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.driver_client_cert = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.extra_capabilities = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.filter_function    = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.goodness_function  = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.iser_helper        = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.iser_ip_address    = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.iser_port          = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.lvm_share_target   = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.lvm_type           = auto {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.num_shell_tries    = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.replication_device = **** {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.report_discard_supported = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.reserved_percentage = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.scst_target_driver = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.storage_protocol   = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.target_helper      = lioadm {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.target_ip_address  = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.target_port        = 3260 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.trace_flags        = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.use_chap_auth      = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.volume_clear       = zero {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.volume_clear_size  = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] lvmdriver-1.volumes_dir        = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_notifications.driver = [] {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_notifications.retry = -1 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] key_manager.fixed_key          = **** {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] barbican.barbican_api_version  = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] barbican.barbican_endpoint     = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] barbican.barbican_endpoint_type = public {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] barbican.barbican_region_name  = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] barbican.cafile                = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] barbican.certfile              = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] barbican.collect_timing        = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] barbican.insecure              = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] barbican.keyfile               = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] barbican.number_of_retries     = 60 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] barbican.retry_delay           = 1 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] barbican.send_service_user_token = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] barbican.split_loggers         = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] barbican.timeout               = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] barbican.verify_ssl            = True {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] barbican.verify_ssl_path       = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] barbican_service_user.auth_section = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] barbican_service_user.auth_type = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] barbican_service_user.cafile   = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] barbican_service_user.certfile = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] barbican_service_user.collect_timing = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] barbican_service_user.insecure = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] barbican_service_user.keyfile  = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] barbican_service_user.split_loggers = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] barbican_service_user.timeout  = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] vault.approle_role_id          = **** {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] vault.approle_secret_id        = **** {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] vault.kv_mountpoint            = secret {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] vault.kv_path                  = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] vault.kv_version               = 2 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] vault.namespace                = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] vault.root_token_id            = **** {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] vault.ssl_ca_crt_file          = None {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] vault.timeout                  = 60.0 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] vault.use_ssl                  = False {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:20:03 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] ******************************************************************************** {{(pid=72232) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 02 10:20:03 devstack sudo[72340]: pam_unix(sudo:session): session closed for user root
Apr 02 10:20:03 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.505s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:20:03 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:20:03 devstack sudo[72491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 02 10:20:03 devstack sudo[72491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:20:03 devstack sudo[72491]: pam_unix(sudo:session): session closed for user root
Apr 02 10:20:03 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.486s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:20:03 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 02 10:20:03 devstack cinder-volume[72336]: INFO cinder.brick.local_dev.lvm [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 02 10:20:03 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:20:04 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:20:04 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:20:04 devstack sudo[72683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 02 10:20:04 devstack sudo[72683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:20:04 devstack sudo[72683]: pam_unix(sudo:session): session closed for user root
Apr 02 10:20:04 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.559s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:20:04 devstack cinder-volume[72336]: DEBUG cinder.brick.local_dev.lvm [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72336) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 02 10:20:04 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:20:04 devstack sudo[72857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 02 10:20:04 devstack sudo[72857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:20:05 devstack sudo[72857]: pam_unix(sudo:session): session closed for user root
Apr 02 10:20:05 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.792s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:20:05 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:20:05 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:20:05 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:20:05 devstack sudo[73000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 02 10:20:05 devstack sudo[73000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:20:05 devstack sudo[73000]: pam_unix(sudo:session): session closed for user root
Apr 02 10:20:05 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.476s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:20:05 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:20:05 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:20:05 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:20:05 devstack sudo[73026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 02 10:20:05 devstack sudo[73026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:20:06 devstack sudo[73026]: pam_unix(sudo:session): session closed for user root
Apr 02 10:20:06 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.435s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:20:06 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:20:06 devstack sudo[73029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 02 10:20:06 devstack sudo[73029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:20:06 devstack sudo[73029]: pam_unix(sudo:session): session closed for user root
Apr 02 10:20:06 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.436s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:20:06 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:20:06 devstack sudo[73034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 02 10:20:06 devstack sudo[73034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:20:07 devstack sudo[73034]: pam_unix(sudo:session): session closed for user root
Apr 02 10:20:07 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.458s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:20:07 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:20:07 devstack sudo[73037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 02 10:20:07 devstack sudo[73037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:20:07 devstack sudo[73037]: pam_unix(sudo:session): session closed for user root
Apr 02 10:20:07 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:20:07 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:20:07 devstack sudo[73045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 02 10:20:07 devstack sudo[73045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:20:08 devstack sudo[73045]: pam_unix(sudo:session): session closed for user root
Apr 02 10:20:08 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.426s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:20:08 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:20:08 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:20:08 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:20:08 devstack sudo[73049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 02 10:20:08 devstack sudo[73049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:20:08 devstack sudo[73049]: pam_unix(sudo:session): session closed for user root
Apr 02 10:20:08 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.469s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:20:08 devstack cinder-volume[72336]: INFO cinder.volume.drivers.lvm [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 02 10:20:08 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:20:08 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:20:08 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:20:08 devstack sudo[73056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 02 10:20:08 devstack sudo[73056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:20:09 devstack sudo[73056]: pam_unix(sudo:session): session closed for user root
Apr 02 10:20:09 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.595s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:20:09 devstack cinder-volume[72336]: DEBUG cinder.volume.drivers.lvm [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Updating volume stats {{(pid=72336) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 02 10:20:09 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:20:09 devstack sudo[73172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 02 10:20:09 devstack sudo[73172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:20:09 devstack sudo[73172]: pam_unix(sudo:session): session closed for user root
Apr 02 10:20:09 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.463s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:20:09 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:20:09 devstack sudo[73178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 02 10:20:09 devstack sudo[73178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:20:10 devstack sudo[73178]: pam_unix(sudo:session): session closed for user root
Apr 02 10:20:10 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.441s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:20:10 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:20:10 devstack sudo[73317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 02 10:20:10 devstack sudo[73317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:20:10 devstack sudo[73317]: pam_unix(sudo:session): session closed for user root
Apr 02 10:20:10 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.472s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:20:10 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:20:10 devstack sudo[73320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 02 10:20:10 devstack sudo[73320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:20:11 devstack sudo[73320]: pam_unix(sudo:session): session closed for user root
Apr 02 10:20:11 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.457s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:20:11 devstack cinder-volume[72336]: INFO cinder.volume.driver [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Driver hasn't implemented _init_vendor_properties()
Apr 02 10:20:11 devstack cinder-volume[72336]: DEBUG cinder.volume.driver [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72336) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 02 10:20:11 devstack cinder-volume[72336]: DEBUG oslo_db.sqlalchemy.engines [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72336) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 02 10:20:11 devstack cinder-volume[72336]: DEBUG dbcounter [-] [72336] Writer thread running {{(pid=72336) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 02 10:20:11 devstack cinder-volume[72336]: DEBUG cinder.db.sqlalchemy.api [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Building query based on filter {{(pid=72336) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 02 10:20:11 devstack cinder-volume[72336]: DEBUG cinder.image.image_utils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72336) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 02 10:20:11 devstack cinder-volume[72336]: INFO cinder.keymgr.migration [None req-6ca1067d-c93f-4479-a870-92239147e704 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 02 10:20:11 devstack cinder-volume[72336]: DEBUG cinder.volume.drivers.lvm [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Updating volume stats {{(pid=72336) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 02 10:20:11 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:20:11 devstack sudo[73325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 02 10:20:11 devstack sudo[73325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:20:11 devstack sudo[73325]: pam_unix(sudo:session): session closed for user root
Apr 02 10:20:11 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.472s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:20:11 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:20:11 devstack sudo[73329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 02 10:20:11 devstack sudo[73329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:20:12 devstack sudo[73329]: pam_unix(sudo:session): session closed for user root
Apr 02 10:20:12 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.489s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:20:12 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:20:12 devstack sudo[73335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 02 10:20:12 devstack sudo[73335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:20:12 devstack sudo[73335]: pam_unix(sudo:session): session closed for user root
Apr 02 10:20:12 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.451s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:20:12 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:20:12 devstack sudo[73339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 02 10:20:12 devstack sudo[73339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:20:12 devstack cinder-volume[72232]: DEBUG dbcounter [-] [72232] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72232) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 02 10:20:13 devstack sudo[73339]: pam_unix(sudo:session): session closed for user root
Apr 02 10:20:13 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.502s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:20:13 devstack cinder-volume[72336]: DEBUG cinder.manager [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Notifying Schedulers of capabilities ... {{(pid=72336) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:20:13 devstack cinder-volume[72336]: INFO cinder.volume.manager [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Driver initialization completed successfully.
Apr 02 10:20:13 devstack cinder-volume[72336]: INFO cinder.manager [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Initiating service 2 cleanup
Apr 02 10:20:13 devstack cinder-volume[72336]: INFO cinder.manager [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Service 2 cleanup completed.
Apr 02 10:20:13 devstack cinder-volume[72336]: DEBUG cinder.service [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Creating RPC server for service cinder-volume {{(pid=72336) start /opt/stack/cinder/cinder/service.py:231}}
Apr 02 10:20:13 devstack cinder-volume[72336]: DEBUG cinder.service [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72336) start /opt/stack/cinder/cinder/service.py:237}}
Apr 02 10:20:13 devstack cinder-volume[72336]: INFO cinder.volume.manager [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 02 10:20:13 devstack cinder-volume[72336]: DEBUG cinder.volume.drivers.lvm [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Updating volume stats {{(pid=72336) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 02 10:20:13 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:20:13 devstack sudo[73345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 02 10:20:13 devstack sudo[73345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:20:13 devstack sudo[73345]: pam_unix(sudo:session): session closed for user root
Apr 02 10:20:13 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.586s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:20:13 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:20:13 devstack sudo[73352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 02 10:20:13 devstack sudo[73352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:20:14 devstack sudo[73352]: pam_unix(sudo:session): session closed for user root
Apr 02 10:20:14 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.493s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:20:14 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:20:14 devstack sudo[73355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 02 10:20:14 devstack sudo[73355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:20:14 devstack sudo[73355]: pam_unix(sudo:session): session closed for user root
Apr 02 10:20:14 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.507s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:20:14 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:20:14 devstack sudo[73412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 02 10:20:14 devstack sudo[73412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:20:15 devstack sudo[73412]: pam_unix(sudo:session): session closed for user root
Apr 02 10:20:15 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.473s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:20:15 devstack cinder-volume[72336]: INFO cinder.volume.manager [None req-b7d8c92f-43b2-4b95-aa68-71628eb998e3 None None] Driver post RPC initialization completed successfully.
Apr 02 10:20:25 devstack cinder-volume[72336]: DEBUG dbcounter [-] [72336] Writing DB stats cinder:SELECT=3 {{(pid=72336) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 02 10:20:25 devstack cinder-volume[72336]: DEBUG dbcounter [-] [72336] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72336) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 02 10:21:43 devstack cinder-volume[72336]: DEBUG oslo_service.periodic_task [None req-527710c7-4e86-4729-bb45-76ec0b94d504 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72336) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 02 10:21:43 devstack cinder-volume[72336]: DEBUG cinder.volume.drivers.lvm [None req-527710c7-4e86-4729-bb45-76ec0b94d504 None None] Updating volume stats {{(pid=72336) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 02 10:21:43 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-527710c7-4e86-4729-bb45-76ec0b94d504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:21:43 devstack sudo[78395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 02 10:21:43 devstack sudo[78395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:21:43 devstack sudo[78395]: pam_unix(sudo:session): session closed for user root
Apr 02 10:21:43 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-527710c7-4e86-4729-bb45-76ec0b94d504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.446s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:21:43 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-527710c7-4e86-4729-bb45-76ec0b94d504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:21:43 devstack sudo[78401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 02 10:21:43 devstack sudo[78401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:21:44 devstack sudo[78401]: pam_unix(sudo:session): session closed for user root
Apr 02 10:21:44 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-527710c7-4e86-4729-bb45-76ec0b94d504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.426s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:21:44 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-527710c7-4e86-4729-bb45-76ec0b94d504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:21:44 devstack sudo[78404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 02 10:21:44 devstack sudo[78404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:21:44 devstack sudo[78404]: pam_unix(sudo:session): session closed for user root
Apr 02 10:21:44 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-527710c7-4e86-4729-bb45-76ec0b94d504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.409s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:21:44 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-527710c7-4e86-4729-bb45-76ec0b94d504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:21:44 devstack sudo[78407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 02 10:21:44 devstack sudo[78407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:21:44 devstack sudo[78407]: pam_unix(sudo:session): session closed for user root
Apr 02 10:21:44 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-527710c7-4e86-4729-bb45-76ec0b94d504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.427s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:21:44 devstack cinder-volume[72336]: DEBUG cinder.manager [None req-527710c7-4e86-4729-bb45-76ec0b94d504 None None] Notifying Schedulers of capabilities ... {{(pid=72336) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:22:25 devstack cinder-volume[72336]: DEBUG dbcounter [-] [72336] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=72336) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 02 10:22:43 devstack cinder-volume[72336]: DEBUG oslo_service.periodic_task [None req-527710c7-4e86-4729-bb45-76ec0b94d504 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72336) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 02 10:22:43 devstack cinder-volume[72336]: DEBUG cinder.volume.drivers.lvm [None req-527710c7-4e86-4729-bb45-76ec0b94d504 None None] Updating volume stats {{(pid=72336) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 02 10:22:43 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-527710c7-4e86-4729-bb45-76ec0b94d504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:22:43 devstack sudo[80220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 02 10:22:43 devstack sudo[80220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:22:43 devstack sudo[80220]: pam_unix(sudo:session): session closed for user root
Apr 02 10:22:43 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-527710c7-4e86-4729-bb45-76ec0b94d504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.428s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:22:43 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-527710c7-4e86-4729-bb45-76ec0b94d504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:22:43 devstack sudo[80223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 02 10:22:43 devstack sudo[80223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:22:44 devstack sudo[80223]: pam_unix(sudo:session): session closed for user root
Apr 02 10:22:44 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-527710c7-4e86-4729-bb45-76ec0b94d504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.429s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:22:44 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-527710c7-4e86-4729-bb45-76ec0b94d504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:22:44 devstack sudo[80229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 02 10:22:44 devstack sudo[80229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:22:44 devstack sudo[80229]: pam_unix(sudo:session): session closed for user root
Apr 02 10:22:44 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-527710c7-4e86-4729-bb45-76ec0b94d504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.451s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:22:44 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-527710c7-4e86-4729-bb45-76ec0b94d504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:22:44 devstack sudo[80232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 02 10:22:44 devstack sudo[80232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:22:45 devstack sudo[80232]: pam_unix(sudo:session): session closed for user root
Apr 02 10:22:45 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-527710c7-4e86-4729-bb45-76ec0b94d504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.485s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:22:45 devstack cinder-volume[72336]: DEBUG cinder.manager [None req-527710c7-4e86-4729-bb45-76ec0b94d504 None None] Notifying Schedulers of capabilities ... {{(pid=72336) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:23:42 devstack cinder-volume[72232]: INFO oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] Caught SIGTERM, stopping children
Apr 02 10:23:42 devstack cinder-volume[72232]: DEBUG oslo_concurrency.lockutils [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] Acquiring lock "singleton_lock" {{(pid=72232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 02 10:23:42 devstack cinder-volume[72232]: DEBUG oslo_concurrency.lockutils [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] Acquired lock "singleton_lock" {{(pid=72232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 02 10:23:42 devstack cinder-volume[72232]: DEBUG oslo_concurrency.lockutils [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] Releasing lock "singleton_lock" {{(pid=72232) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 02 10:23:42 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] Stop services. {{(pid=72232) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 02 10:23:42 devstack cinder-volume[72232]: DEBUG oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] Killing children. {{(pid=72232) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 02 10:23:42 devstack cinder-volume[72232]: INFO oslo_service.backend._eventlet.service [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] Waiting on 1 children to exit
Apr 02 10:23:43 devstack cinder-volume[72336]: DEBUG oslo_service.periodic_task [None req-527710c7-4e86-4729-bb45-76ec0b94d504 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72336) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 02 10:23:43 devstack cinder-volume[72336]: DEBUG cinder.volume.drivers.lvm [None req-527710c7-4e86-4729-bb45-76ec0b94d504 None None] Updating volume stats {{(pid=72336) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 02 10:23:43 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-527710c7-4e86-4729-bb45-76ec0b94d504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:23:43 devstack sudo[81522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 02 10:23:43 devstack sudo[81522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:23:43 devstack sudo[81522]: pam_unix(sudo:session): session closed for user root
Apr 02 10:23:43 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-527710c7-4e86-4729-bb45-76ec0b94d504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.417s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:23:43 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-527710c7-4e86-4729-bb45-76ec0b94d504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:23:43 devstack sudo[81525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 02 10:23:43 devstack sudo[81525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:23:44 devstack sudo[81525]: pam_unix(sudo:session): session closed for user root
Apr 02 10:23:44 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-527710c7-4e86-4729-bb45-76ec0b94d504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.422s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:23:44 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-527710c7-4e86-4729-bb45-76ec0b94d504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:23:44 devstack sudo[81528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 02 10:23:44 devstack sudo[81528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:23:44 devstack sudo[81528]: pam_unix(sudo:session): session closed for user root
Apr 02 10:23:44 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-527710c7-4e86-4729-bb45-76ec0b94d504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.411s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:23:44 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-527710c7-4e86-4729-bb45-76ec0b94d504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:23:44 devstack sudo[81531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 02 10:23:44 devstack sudo[81531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:23:44 devstack sudo[81531]: pam_unix(sudo:session): session closed for user root
Apr 02 10:23:44 devstack cinder-volume[72336]: DEBUG oslo_concurrency.processutils [None req-527710c7-4e86-4729-bb45-76ec0b94d504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.405s {{(pid=72336) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:23:44 devstack cinder-volume[72336]: DEBUG cinder.manager [None req-527710c7-4e86-4729-bb45-76ec0b94d504 None None] Notifying Schedulers of capabilities ... {{(pid=72336) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:23:47 devstack cinder-volume[72336]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Apr 02 10:23:48 devstack cinder-volume[72336]: DEBUG oslo_concurrency.lockutils [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] Acquiring lock "singleton_lock" {{(pid=72336) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 02 10:23:48 devstack cinder-volume[72336]: DEBUG oslo_concurrency.lockutils [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] Acquired lock "singleton_lock" {{(pid=72336) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 02 10:23:48 devstack cinder-volume[72336]: DEBUG oslo_concurrency.lockutils [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] Releasing lock "singleton_lock" {{(pid=72336) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 02 10:23:48 devstack cinder-volume[72336]: WARNING amqp [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 02 10:23:48 devstack cinder-volume[72336]: WARNING amqp [None req-74636d5f-e788-4013-ae0b-4092b7180705 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81568) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81568) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81568) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 02 10:23:50 devstack cinder-volume[81568]: INFO dbcounter [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] Registered counter for database cinder
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_db.sqlalchemy.engines [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81568) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG dbcounter [-] [81568] Writer thread running {{(pid=81568) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 02 10:23:50 devstack cinder-volume[81568]: INFO cinder.rpc [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 02 10:23:50 devstack cinder-volume[81568]: INFO cinder.rpc [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_db.sqlalchemy.engines [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81568) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 02 10:23:50 devstack cinder-volume[81568]: INFO cinder.volume.manager [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] Determined volume DB was empty at startup.
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG cinder.volume.manager [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81568) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 02 10:23:50 devstack cinder-volume[81568]: INFO cinder.volume.manager [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 02 10:23:50 devstack cinder-volume[81568]: WARNING stevedore.named [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 02 10:23:50 devstack cinder-volume[81568]: WARNING castellan.key_manager [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 02 10:23:50 devstack cinder-volume[81568]: WARNING cinder.keymgr.conf_key_mgr [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 02 10:23:50 devstack cinder-volume[81568]: INFO cinder.volume.manager [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_db.sqlalchemy.engines [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81568) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 02 10:23:50 devstack cinder-volume[81568]: INFO oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] Starting 1 workers
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] Started child 81687 {{(pid=81568) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] Full set of CONF: {{(pid=81568) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] ******************************************************************************** {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] Configuration options gathered from: {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] ================================================================================ {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] allow_availability_zone_fallback = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] allow_compression_on_image_upload = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81687]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] allowed_direct_url_schemes     = [] {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] api_rate_limit                 = True {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] auth_strategy                  = keystone {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_availability_zone      = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_host                   = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_name                   = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_stats_polling_interval = 60 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backup_api_class               = cinder.backup.api.API {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backup_name_template           = backup-%s {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backup_use_same_host           = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backup_use_temp_snapshot       = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] chap_password                  = **** {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] chap_username                  =  {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cinder_internal_tenant_project_id = a4d9611332ab4517b7f068416a38179e {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cinder_internal_tenant_user_id = 2164910458c644d2b907e5d12db97622 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cluster                        = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] compression_format             = gzip {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] compute_api_class              = cinder.compute.nova.API {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] config_dir                     = [] {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] config_source                  = [] {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] control_exchange               = openstack {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] debug                          = True {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] default_availability_zone      = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] default_group_type             = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] default_volume_type            = QuobyteHD {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] disk_geometry                  = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] driver_client_cert             = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] driver_client_cert_key         = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] driver_data_namespace          = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] driver_ssl_cert_path           = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] driver_ssl_cert_verify         = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] driver_use_ssl                 = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] enable_new_services            = True {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] enable_unsupported_driver      = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] enabled_backends               = ['QuobyteHD'] {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] enforce_multipath_for_image_xfer = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] filter_function                = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] glance_api_insecure            = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] glance_api_servers             = ['http://192.168.122.180/image'] {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] glance_api_ssl_compression     = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] glance_ca_certificates_file    = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] glance_catalog_info            = image:glance:publicURL {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] glance_certfile                = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] glance_keyfile                 = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] glance_num_retries             = 3 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] glance_request_timeout         = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] goodness_function              = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] graceful_shutdown_timeout      = 5 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] group_api_class                = cinder.group.api.API {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] host                           = devstack {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] image_compress_on_upload       = True {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] image_conversion_address_space_limit = 1 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] image_conversion_cpu_limit     = 60 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] image_conversion_disable       = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] image_upload_use_cinder_backend = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] image_upload_use_internal_tenant = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] image_volume_cache_enabled     = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] image_volume_cache_max_count   = 0 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] image_volume_cache_max_size_gb = 0 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] init_host_max_objects_retrieval = 0 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] instance_format                = [instance: %(uuid)s]  {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] iscsi_target_flags             =  {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] iscsi_write_cache              = on {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] iser_helper                    = tgtadm {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] iser_ip_address                = 192.168.122.180 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] iser_port                      = 3260 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] log_color                      = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] log_config_append              = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] log_dir                        = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] log_file                       = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] log_options                    = True {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] log_rotate_interval            = 1 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] log_rotate_interval_type       = days {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] log_rotation_type              = none {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] max_age                        = 0 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] max_logfile_count              = 30 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] max_logfile_size_mb            = 200 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] max_over_subscription_ratio    = 20.0 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] message_reap_interval          = 86400 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] message_ttl                    = 2592000 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] migration_create_volume_timeout_secs = 300 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] monkey_patch                   = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] monkey_patch_modules           = [] {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] my_ip                          = 192.168.122.180 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] no_snapshot_gb_quota           = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81687]: INFO cinder.volume.manager [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] num_iser_scan_tries            = 3 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81687]: DEBUG cinder.volume.drivers.remotefs [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81687) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] num_shell_tries                = 3 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] num_volume_device_scan_tries   = 3 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] nvmeof_conn_info_version       = 1 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] nvmet_ns_id                    = 10 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] nvmet_port_id                  = 1 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] osapi_max_limit                = 1000 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] osapi_volume_ext_list          = [] {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] osapi_volume_listen            = 0.0.0.0 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] osapi_volume_listen_port       = 8776 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] osapi_volume_use_ssl           = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] osapi_volume_workers           = 2 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] per_volume_size_limit          = -1 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] periodic_fuzzy_delay           = 60 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] periodic_interval              = 60 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] project_id_regex               = [0-9a-f\-]+ {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] public_endpoint                = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] publish_errors                 = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] quota_backup_gigabytes         = 1000 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] quota_backups                  = 10 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] quota_gigabytes                = 1000 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] quota_groups                   = 10 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] quota_snapshots                = 10 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] quota_volumes                  = 10 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] rate_limit_burst               = 0 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] rate_limit_except_level        = CRITICAL {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] rate_limit_interval            = 0 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] reinit_driver_count            = 3 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] replication_device             = **** {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] report_discard_supported       = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] report_interval                = 120 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] reservation_clean_interval     = 86400 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] reservation_expire             = 86400 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] reserved_image_namespaces      = [] {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] reserved_percentage            = 0 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] rpc_response_timeout           = 120 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] run_external_periodic_tasks    = True {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] scst_target_driver             = iscsi {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] scst_target_iqn_name           = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] service_down_time              = 720 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] shell_completion               = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] snapshot_name_template         = snapshot-%s {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] split_loggers                  = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] state_path                     = /opt/stack/data/cinder {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] storage_availability_zone      = nova {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] storage_protocol               = iSCSI {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] syslog_log_facility            = LOG_USER {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] target_helper                  = lioadm {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] target_ip_address              = 192.168.122.180 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] target_port                    = 3260 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] target_protocol                = iscsi {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] target_secondary_ip_addresses  = [] {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] trace_flags                    = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] transfer_api_class             = cinder.transfer.api.API {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] transport_url                  = **** {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] until_refresh                  = 0 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] use_chap_auth                  = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] use_default_quota_class        = True {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] use_journal                    = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] use_json                       = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] use_multipath_for_image_xfer   = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] use_stderr                     = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] use_syslog                     = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:50 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] verify_glance_signatures       = enabled {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] volume_api_class               = cinder.volume.api.API {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] volume_backend_name            = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] volume_clear                   = zero {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] volume_clear_ionice            = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] volume_clear_size              = 0 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] volume_copy_bps_limit          = 0 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] volume_dd_blocksize            = 1M {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] volume_name_template           = volume-%s {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] volume_service_inithost_offload = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] volume_usage_audit_period      = month {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] zoning_mode                    = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_concurrency.disable_process_locking = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.admin_password = **** {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.admin_token = **** {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.admin_user  = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.auth_admin_prefix =  {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.auth_port   = 35357 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.auth_protocol = https {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.auth_section = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.auth_type   = password {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.auth_uri    = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.auth_version = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.cache       = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.certfile    = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.delay_auth_decision = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.http_connect_timeout = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.identity_uri = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.include_service_catalog = True {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.insecure    = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.interface   = public {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.keyfile     = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.memcache_password =  {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.memcache_username =  {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.region_name = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.service_token_roles_required = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.service_type = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.token_cache_time = 300 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.180/identity {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.backend                  = dogpile.cache.null {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.backend_argument         = **** {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.backend_expiration_time  = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.config_prefix            = cache.oslo {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.debug_cache_backend      = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.enable_retry_client      = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.enable_socket_keepalive  = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.enabled                  = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.enforce_fips_mode        = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.expiration_time          = 600 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.hashclient_retry_attempts = 2 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.memcache_dead_retry      = 300 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.memcache_pool_maxsize    = 10 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.memcache_sasl_enabled    = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.password                 = **** {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.proxies                  = [] {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.redis_db                 = 0 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.redis_sentinel_service_name = mymaster {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.redis_server             = localhost:6379 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.retry_attempts           = 2 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.retry_delay              = 0.0 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.socket_keepalive_count   = 1 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.socket_keepalive_idle    = 1 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.socket_keepalive_interval = 1 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.socket_timeout           = 1.0 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.tls_allowed_ciphers      = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.tls_cafile               = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.tls_certfile             = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.tls_enabled              = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.tls_keyfile              = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cache.username                 = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] coordination.backend_url       = **** {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] database.asyncio_connection    = **** {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] database.asyncio_slave_connection = **** {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] database.backend               = sqlalchemy {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] database.connection            = **** {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] database.connection_debug      = 0 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] database.connection_parameters =  {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] database.connection_recycle_time = 3600 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] database.connection_trace      = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] database.db_inc_retry_interval = True {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] database.db_max_retries        = 20 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] database.db_max_retry_interval = 10 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] database.db_retry_interval     = 1 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] database.max_overflow          = 50 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] database.max_pool_size         = 5 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] database.max_retries           = 10 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] database.mysql_wsrep_sync_wait = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] database.pool_timeout          = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] database.retry_interval        = 10 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] database.slave_connection      = **** {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] database.sqlite_synchronous    = True {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] database.synchronous_reader    = True {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] database.use_db_reconnect      = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] profiler.connection_string     = messaging:// {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] profiler.enabled               = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] profiler.es_doc_type           = notification {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] profiler.es_scroll_size        = 10000 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] profiler.es_scroll_time        = 2m {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] profiler.filter_error_trace    = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] profiler.hmac_keys             = **** {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] profiler.sentinel_service_name = mymaster {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] profiler.socket_timeout        = 0.1 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81687]: DEBUG cinder.volume.drivers.quobyte [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81687) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] profiler.trace_requests        = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] profiler.trace_sqlalchemy      = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] profiler_jaeger.process_tags   = {} {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81687]: WARNING cinder.volume.drivers.quobyte [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] profiler_jaeger.service_name_prefix = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81687]: WARNING cinder.volume.drivers.quobyte [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] profiler_otlp.service_name_prefix = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_policy.enforce_new_defaults = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: WARNING oslo_config.cfg [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_policy.enforce_scope      = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_policy.policy_default_rule = default {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_policy.policy_file        = policy.yaml {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81687]: DEBUG oslo_concurrency.processutils [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] Running cmd (subprocess): mount.quobyte {{(pid=81687) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_policy.remote_timeout     = 60.0 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] privsep_osbrick.group          = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] privsep_osbrick.helper_command = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] privsep_osbrick.user           = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cinder_sys_admin.group         = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cinder_sys_admin.helper_command = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] cinder_sys_admin.user          = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] service_user.auth_section      = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] service_user.auth_type         = password {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] service_user.cafile            = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] service_user.certfile          = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] service_user.collect_timing    = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] service_user.insecure          = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] service_user.keyfile           = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] service_user.send_service_user_token = True {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] service_user.split_loggers     = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] service_user.timeout           = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] glance.auth_section            = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] glance.auth_type               = password {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] glance.certfile                = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] glance.collect_timing          = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] glance.insecure                = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] glance.keyfile                 = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] glance.region_name             = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] glance.split_loggers           = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] glance.timeout                 = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.backend_availability_zone = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.chap_password = **** {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.chap_username =  {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.disk_geometry = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.driver_client_cert = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.driver_client_cert_key = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.driver_data_namespace = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.driver_use_ssl = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.enable_unsupported_driver = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.extra_capabilities = {} {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.filter_function = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.goodness_function = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.iscsi_target_flags =  {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.iscsi_write_cache = on {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.iser_helper   = tgtadm {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.iser_ip_address = 192.168.122.180 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.iser_port     = 3260 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.nas_host      =  {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.nas_login     = admin {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.nas_mount_options = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.nas_password  = **** {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.nas_private_key =  {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.nas_share_path =  {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.nas_ssh_port  = 22 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.num_shell_tries = 3 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.nvmet_port_id = 1 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.quobyte_client_cfg = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.quobyte_volume_url = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.replication_device = **** {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.report_discard_supported = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.reserved_percentage = 0 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.scst_target_driver = iscsi {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.scst_target_iqn_name = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.storage_protocol = iSCSI {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.target_helper = tgtadm {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.target_ip_address = 192.168.122.180 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.target_port   = 3260 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.target_protocol = iscsi {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.trace_flags   = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.unique_fqdn_network = True {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.use_chap_auth = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.volume_backend_name = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.volume_clear  = zero {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.volume_clear_ionice = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.volume_clear_size = 0 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_reports.file_event_handler = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_reports.log_dir           = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.backend_availability_zone = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.backend_host         = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.chap_password        = **** {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.chap_username        = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.chiscsi_conf         = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.disk_geometry        = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.driver_client_cert   = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.driver_client_cert_key = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.driver_data_namespace = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.driver_use_ssl       = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.extra_capabilities   = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.filter_function      = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.goodness_function    = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.iscsi_target_flags   = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.iscsi_write_cache    = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.iser_helper          = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.iser_ip_address      = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.iser_port            = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.iser_target_prefix   = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.nas_host             = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.nas_login            = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.nas_mount_options    = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.nas_password         = **** {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.nas_private_key      = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.nas_share_path       = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.nas_ssh_port         = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.num_shell_tries      = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.nvmet_ns_id          = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.nvmet_port_id        = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.replication_device   = **** {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.report_discard_supported = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.reserved_percentage  = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.scst_target_driver   = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.storage_protocol     = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.target_helper        = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.target_ip_address    = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.target_port          = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.target_prefix        = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.target_protocol      = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.trace_flags          = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.unique_fqdn_network  = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.use_chap_auth        = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.volume_clear         = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.volume_clear_ionice  = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.volume_clear_size    = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] QuobyteHD.volumes_dir          = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.ssl      = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.ssl_version =  {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_notifications.driver = [] {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_notifications.retry = -1 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] oslo_messaging_notifications.transport_url = **** {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] key_manager.fixed_key          = **** {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] barbican.barbican_api_version  = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] barbican.barbican_endpoint     = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] barbican.barbican_endpoint_type = public {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] barbican.barbican_region_name  = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] barbican.cafile                = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] barbican.certfile              = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] barbican.collect_timing        = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] barbican.insecure              = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] barbican.keyfile               = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] barbican.number_of_retries     = 60 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] barbican.retry_delay           = 1 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] barbican.send_service_user_token = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] barbican.split_loggers         = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] barbican.timeout               = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] barbican.verify_ssl            = True {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] barbican.verify_ssl_path       = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] barbican_service_user.auth_section = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] barbican_service_user.auth_type = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] barbican_service_user.cafile   = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] barbican_service_user.certfile = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] barbican_service_user.collect_timing = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] barbican_service_user.insecure = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] barbican_service_user.keyfile  = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] barbican_service_user.split_loggers = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] barbican_service_user.timeout  = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] vault.approle_role_id          = **** {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] vault.approle_secret_id        = **** {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] vault.kv_mountpoint            = secret {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] vault.kv_path                  = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] vault.kv_version               = 2 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] vault.namespace                = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] vault.root_token_id            = **** {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] vault.ssl_ca_crt_file          = None {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] vault.timeout                  = 60.0 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] vault.use_ssl                  = False {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:23:51 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] ******************************************************************************** {{(pid=81568) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 02 10:23:51 devstack quobyte-client[81688]: Reading configuration file: /etc/quobyte/client.cfg
Apr 02 10:23:51 devstack quobyte-client[81688]: Invalid parameters found, error: missing mount point.
Apr 02 10:23:51 devstack quobyte-client[81688]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 02 10:23:51 devstack quobyte-client[81688]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 02 10:23:51 devstack cinder-volume[81687]: DEBUG oslo_concurrency.processutils [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] CMD "mount.quobyte" returned: 1 in 0.091s {{(pid=81687) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:23:51 devstack cinder-volume[81687]: DEBUG oslo_concurrency.lockutils [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81687) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:23:51 devstack cinder-volume[81687]: DEBUG oslo_concurrency.lockutils [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81687) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:23:51 devstack cinder-volume[81687]: DEBUG cinder.volume.drivers.quobyte [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=81687) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:23:51 devstack cinder-volume[81687]: INFO cinder.volume.drivers.quobyte [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 ...
Apr 02 10:23:51 devstack cinder-volume[81687]: DEBUG oslo_concurrency.processutils [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 -c /etc/quobyte/client-cinder.cfg {{(pid=81687) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:23:51 devstack sudo[81689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 -c /etc/quobyte/client-cinder.cfg
Apr 02 10:23:51 devstack sudo[81689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:23:51 devstack sudo[81689]: pam_unix(sudo:session): session closed for user root
Apr 02 10:23:51 devstack cinder-volume[81687]: DEBUG oslo_concurrency.processutils [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.480s {{(pid=81687) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:23:51 devstack cinder-volume[81687]: INFO cinder.volume.drivers.quobyte [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 succeeded
Apr 02 10:23:51 devstack cinder-volume[81687]: DEBUG cinder.volume.drivers.quobyte [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=81687) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:23:51 devstack cinder-volume[81687]: DEBUG oslo_concurrency.lockutils [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.510s {{(pid=81687) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:23:51 devstack cinder-volume[81687]: DEBUG oslo_concurrency.processutils [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=81687) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:23:51 devstack sudo[81758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:23:51 devstack sudo[81758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:23:52 devstack sudo[81758]: pam_unix(sudo:session): session closed for user root
Apr 02 10:23:52 devstack cinder-volume[81687]: DEBUG oslo_concurrency.processutils [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.401s {{(pid=81687) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:23:52 devstack cinder-volume[81687]: INFO cinder.volume.driver [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] Driver hasn't implemented _init_vendor_properties()
Apr 02 10:23:52 devstack cinder-volume[81687]: DEBUG cinder.volume.driver [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757984161377, 'free_capacity_gb': 1775.757984161377, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81687) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 02 10:23:52 devstack cinder-volume[81687]: DEBUG oslo_db.sqlalchemy.engines [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81687) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 02 10:23:52 devstack cinder-volume[81687]: DEBUG dbcounter [-] [81687] Writer thread running {{(pid=81687) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 02 10:23:52 devstack cinder-volume[81687]: DEBUG cinder.db.sqlalchemy.api [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] Building query based on filter {{(pid=81687) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 02 10:23:52 devstack cinder-volume[81687]: DEBUG cinder.image.image_utils [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81687) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 02 10:23:52 devstack cinder-volume[81687]: INFO cinder.keymgr.migration [None req-742bca74-c3c6-4716-8ae9-9a44043fbcfa None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 02 10:23:52 devstack cinder-volume[81687]: DEBUG oslo_concurrency.lockutils [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81687) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:23:52 devstack cinder-volume[81687]: DEBUG oslo_concurrency.lockutils [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81687) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:23:52 devstack cinder-volume[81687]: DEBUG cinder.volume.drivers.quobyte [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=81687) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:23:52 devstack cinder-volume[81687]: DEBUG cinder.volume.drivers.quobyte [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=81687) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:23:52 devstack cinder-volume[81687]: DEBUG oslo_concurrency.lockutils [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81687) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:23:52 devstack cinder-volume[81687]: DEBUG oslo_concurrency.processutils [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=81687) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:23:52 devstack sudo[81761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:23:52 devstack sudo[81761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:23:52 devstack sudo[81761]: pam_unix(sudo:session): session closed for user root
Apr 02 10:23:52 devstack cinder-volume[81687]: DEBUG oslo_concurrency.processutils [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.371s {{(pid=81687) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:23:52 devstack cinder-volume[81687]: DEBUG cinder.manager [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] Notifying Schedulers of capabilities ... {{(pid=81687) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:23:52 devstack cinder-volume[81687]: INFO cinder.volume.manager [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] Driver initialization completed successfully.
Apr 02 10:23:52 devstack cinder-volume[81687]: INFO cinder.manager [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] Initiating service 3 cleanup
Apr 02 10:23:52 devstack cinder-volume[81687]: INFO cinder.manager [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] Service 3 cleanup completed.
Apr 02 10:23:52 devstack cinder-volume[81687]: DEBUG cinder.service [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] Creating RPC server for service cinder-volume {{(pid=81687) start /opt/stack/cinder/cinder/service.py:231}}
Apr 02 10:23:52 devstack cinder-volume[81687]: DEBUG cinder.service [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81687) start /opt/stack/cinder/cinder/service.py:237}}
Apr 02 10:23:52 devstack cinder-volume[81687]: INFO cinder.volume.manager [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 02 10:23:52 devstack cinder-volume[81687]: DEBUG oslo_concurrency.lockutils [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81687) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:23:52 devstack cinder-volume[81687]: DEBUG oslo_concurrency.lockutils [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81687) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:23:52 devstack cinder-volume[81687]: DEBUG cinder.volume.drivers.quobyte [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=81687) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:23:52 devstack cinder-volume[81687]: DEBUG cinder.volume.drivers.quobyte [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=81687) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:23:52 devstack cinder-volume[81687]: DEBUG oslo_concurrency.lockutils [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81687) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:23:52 devstack cinder-volume[81687]: DEBUG oslo_concurrency.processutils [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=81687) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:23:52 devstack sudo[81766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:23:52 devstack sudo[81766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:23:53 devstack sudo[81766]: pam_unix(sudo:session): session closed for user root
Apr 02 10:23:53 devstack cinder-volume[81687]: DEBUG oslo_concurrency.processutils [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.484s {{(pid=81687) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:23:53 devstack cinder-volume[81687]: INFO cinder.volume.manager [None req-0085708c-cc5f-42b8-84c4-cff62a7e99d0 None None] Driver post RPC initialization completed successfully.
Apr 02 10:23:55 devstack cinder-volume[81687]: DEBUG oslo_concurrency.lockutils [None req-b00e31b6-0e8b-4509-9fc4-631acaf91017 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81687) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:23:55 devstack cinder-volume[81687]: DEBUG oslo_concurrency.lockutils [None req-b00e31b6-0e8b-4509-9fc4-631acaf91017 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81687) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:23:55 devstack cinder-volume[81687]: DEBUG cinder.volume.drivers.quobyte [None req-b00e31b6-0e8b-4509-9fc4-631acaf91017 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=81687) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:23:55 devstack cinder-volume[81687]: DEBUG cinder.volume.drivers.quobyte [None req-b00e31b6-0e8b-4509-9fc4-631acaf91017 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=81687) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:23:55 devstack cinder-volume[81687]: DEBUG oslo_concurrency.lockutils [None req-b00e31b6-0e8b-4509-9fc4-631acaf91017 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81687) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:23:55 devstack cinder-volume[81687]: DEBUG oslo_concurrency.processutils [None req-b00e31b6-0e8b-4509-9fc4-631acaf91017 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=81687) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:23:55 devstack sudo[81832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:23:55 devstack sudo[81832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:23:56 devstack sudo[81832]: pam_unix(sudo:session): session closed for user root
Apr 02 10:23:56 devstack cinder-volume[81687]: DEBUG oslo_concurrency.processutils [None req-b00e31b6-0e8b-4509-9fc4-631acaf91017 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.383s {{(pid=81687) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:23:56 devstack cinder-volume[81687]: DEBUG cinder.manager [None req-b00e31b6-0e8b-4509-9fc4-631acaf91017 None None] Notifying Schedulers of capabilities ... {{(pid=81687) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:23:56 devstack cinder-volume[81568]: INFO oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] Caught SIGTERM, stopping children
Apr 02 10:23:56 devstack cinder-volume[81568]: DEBUG oslo_concurrency.lockutils [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] Acquiring lock "singleton_lock" {{(pid=81568) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 02 10:23:56 devstack cinder-volume[81568]: DEBUG oslo_concurrency.lockutils [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] Acquired lock "singleton_lock" {{(pid=81568) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 02 10:23:56 devstack cinder-volume[81568]: DEBUG oslo_concurrency.lockutils [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] Releasing lock "singleton_lock" {{(pid=81568) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 02 10:23:56 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] Stop services. {{(pid=81568) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 02 10:23:56 devstack cinder-volume[81568]: DEBUG oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] Killing children. {{(pid=81568) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 02 10:23:56 devstack cinder-volume[81568]: INFO oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] Waiting on 1 children to exit
Apr 02 10:24:00 devstack cinder-volume[81687]: DEBUG oslo_concurrency.lockutils [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] Acquiring lock "singleton_lock" {{(pid=81687) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 02 10:24:00 devstack cinder-volume[81687]: DEBUG oslo_concurrency.lockutils [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] Acquired lock "singleton_lock" {{(pid=81687) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 02 10:24:00 devstack cinder-volume[81687]: DEBUG oslo_concurrency.lockutils [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] Releasing lock "singleton_lock" {{(pid=81687) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 02 10:24:00 devstack cinder-volume[81687]: WARNING amqp [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 02 10:24:00 devstack cinder-volume[81687]: WARNING amqp [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 02 10:24:00 devstack cinder-volume[81568]: INFO oslo_service.backend._eventlet.service [None req-e7b661ea-2add-4da0-a75d-854cf53eeaad None None] Child 81687 exited with status 0
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81916) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81916) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81916) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 02 10:24:03 devstack cinder-volume[81916]: INFO dbcounter [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] Registered counter for database cinder
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_db.sqlalchemy.engines [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81916) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG dbcounter [-] [81916] Writer thread running {{(pid=81916) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 02 10:24:03 devstack cinder-volume[81916]: INFO cinder.rpc [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 02 10:24:03 devstack cinder-volume[81916]: INFO cinder.rpc [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_db.sqlalchemy.engines [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81916) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 02 10:24:03 devstack cinder-volume[81916]: INFO cinder.volume.manager [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] Determined volume DB was empty at startup.
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG cinder.volume.manager [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81916) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 02 10:24:03 devstack cinder-volume[81916]: WARNING stevedore.named [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 02 10:24:03 devstack cinder-volume[81916]: WARNING castellan.key_manager [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 02 10:24:03 devstack cinder-volume[81916]: WARNING cinder.keymgr.conf_key_mgr [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 02 10:24:03 devstack cinder-volume[81916]: INFO cinder.volume.manager [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_db.sqlalchemy.engines [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81916) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 02 10:24:03 devstack cinder-volume[81916]: INFO oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] Starting 1 workers
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] Started child 82102 {{(pid=81916) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] Full set of CONF: {{(pid=81916) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] ******************************************************************************** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] Configuration options gathered from: {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] ================================================================================ {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] allow_availability_zone_fallback = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[82102]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] allow_compression_on_image_upload = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] allowed_direct_url_schemes     = [] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] api_rate_limit                 = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] auth_strategy                  = keystone {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_availability_zone      = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_host                   = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_name                   = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_stats_polling_interval = 60 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backup_api_class               = cinder.backup.api.API {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backup_name_template           = backup-%s {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backup_use_same_host           = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backup_use_temp_snapshot       = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] chap_password                  = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] chap_username                  =  {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cinder_internal_tenant_project_id = a4d9611332ab4517b7f068416a38179e {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cinder_internal_tenant_user_id = 2164910458c644d2b907e5d12db97622 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cluster                        = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] compression_format             = gzip {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] compute_api_class              = cinder.compute.nova.API {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] config_dir                     = [] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] config_source                  = [] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] control_exchange               = openstack {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] debug                          = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] default_availability_zone      = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] default_group_type             = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] default_volume_type            = QuobyteHD {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] disk_geometry                  = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] driver_client_cert             = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] driver_client_cert_key         = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] driver_data_namespace          = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] driver_ssl_cert_path           = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] driver_ssl_cert_verify         = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] driver_use_ssl                 = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] enable_new_services            = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] enable_unsupported_driver      = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] enabled_backends               = ['QuobyteHD'] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] enforce_multipath_for_image_xfer = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] filter_function                = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] glance_api_insecure            = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] glance_api_servers             = ['http://192.168.122.180/image'] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] glance_api_ssl_compression     = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] glance_ca_certificates_file    = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] glance_catalog_info            = image:glance:publicURL {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] glance_certfile                = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] glance_keyfile                 = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] glance_num_retries             = 3 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] glance_request_timeout         = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] goodness_function              = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] graceful_shutdown_timeout      = 5 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] group_api_class                = cinder.group.api.API {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] host                           = devstack {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] image_compress_on_upload       = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] image_conversion_address_space_limit = 1 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] image_conversion_cpu_limit     = 60 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] image_conversion_disable       = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] image_upload_use_cinder_backend = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] image_upload_use_internal_tenant = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] image_volume_cache_enabled     = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] image_volume_cache_max_count   = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] image_volume_cache_max_size_gb = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] init_host_max_objects_retrieval = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] instance_format                = [instance: %(uuid)s]  {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] iscsi_target_flags             =  {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] iscsi_write_cache              = on {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] iser_helper                    = tgtadm {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] iser_ip_address                = 192.168.122.180 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] iser_port                      = 3260 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] log_color                      = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] log_config_append              = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] log_dir                        = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] log_file                       = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] log_options                    = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] log_rotate_interval            = 1 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] log_rotate_interval_type       = days {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] log_rotation_type              = none {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] max_age                        = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] max_logfile_count              = 30 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] max_logfile_size_mb            = 200 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] max_over_subscription_ratio    = 20.0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] message_reap_interval          = 86400 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] message_ttl                    = 2592000 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] migration_create_volume_timeout_secs = 300 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] monkey_patch                   = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] monkey_patch_modules           = [] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] my_ip                          = 192.168.122.180 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] no_snapshot_gb_quota           = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] num_iser_scan_tries            = 3 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] num_shell_tries                = 3 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] num_volume_device_scan_tries   = 3 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] nvmeof_conn_info_version       = 1 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] nvmet_ns_id                    = 10 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] nvmet_port_id                  = 1 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] osapi_max_limit                = 1000 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] osapi_volume_ext_list          = [] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] osapi_volume_listen_port       = 8776 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] osapi_volume_use_ssl           = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] osapi_volume_workers           = 2 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:03 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82102) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] per_volume_size_limit          = -1 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] periodic_fuzzy_delay           = 60 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] periodic_interval              = 60 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] public_endpoint                = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] publish_errors                 = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] quota_backup_gigabytes         = 1000 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] quota_backups                  = 10 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] quota_gigabytes                = 1000 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] quota_groups                   = 10 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] quota_snapshots                = 10 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] quota_volumes                  = 10 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] rate_limit_burst               = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] rate_limit_except_level        = CRITICAL {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] rate_limit_interval            = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] reinit_driver_count            = 3 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] replication_device             = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] report_discard_supported       = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] report_interval                = 120 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] reservation_clean_interval     = 86400 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] reservation_expire             = 86400 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] reserved_image_namespaces      = [] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] reserved_percentage            = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] rpc_response_timeout           = 120 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] run_external_periodic_tasks    = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] scst_target_driver             = iscsi {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] scst_target_iqn_name           = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] service_down_time              = 720 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] shell_completion               = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] snapshot_name_template         = snapshot-%s {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] split_loggers                  = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] state_path                     = /opt/stack/data/cinder {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] storage_availability_zone      = nova {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] storage_protocol               = iSCSI {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] syslog_log_facility            = LOG_USER {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] target_helper                  = lioadm {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] target_ip_address              = 192.168.122.180 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] target_port                    = 3260 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] target_protocol                = iscsi {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] target_secondary_ip_addresses  = [] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] trace_flags                    = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] transport_url                  = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] until_refresh                  = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] use_chap_auth                  = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] use_default_quota_class        = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] use_journal                    = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] use_json                       = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] use_multipath_for_image_xfer   = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] use_stderr                     = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] use_syslog                     = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] verify_glance_signatures       = enabled {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] volume_api_class               = cinder.volume.api.API {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] volume_backend_name            = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] volume_clear                   = zero {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] volume_clear_ionice            = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] volume_clear_size              = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] volume_copy_bps_limit          = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] volume_dd_blocksize            = 1M {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] volume_name_template           = volume-%s {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] volume_service_inithost_offload = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] volume_usage_audit_period      = month {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] zoning_mode                    = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_concurrency.disable_process_locking = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.admin_password = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.admin_token = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.admin_user  = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.auth_port   = 35357 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.auth_protocol = https {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.auth_section = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.auth_type   = password {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.auth_uri    = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.auth_version = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.cache       = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.certfile    = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.identity_uri = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.include_service_catalog = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.insecure    = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.interface   = public {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.keyfile     = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.memcache_password =  {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.memcache_username =  {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.region_name = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.service_type = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.180/identity {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.backend                  = dogpile.cache.null {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.backend_argument         = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.backend_expiration_time  = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.config_prefix            = cache.oslo {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.debug_cache_backend      = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.enable_retry_client      = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.enable_socket_keepalive  = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.enabled                  = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.enforce_fips_mode        = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.expiration_time          = 600 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.hashclient_retry_attempts = 2 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.memcache_dead_retry      = 300 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.memcache_pool_maxsize    = 10 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.memcache_sasl_enabled    = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.password                 = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.proxies                  = [] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.redis_db                 = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.redis_server             = localhost:6379 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.retry_attempts           = 2 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.retry_delay              = 0.0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.socket_keepalive_count   = 1 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.socket_keepalive_idle    = 1 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.socket_keepalive_interval = 1 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.socket_timeout           = 1.0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.tls_allowed_ciphers      = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.tls_cafile               = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.tls_certfile             = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.tls_enabled              = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.tls_keyfile              = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cache.username                 = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] coordination.backend_url       = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] database.asyncio_connection    = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] database.asyncio_slave_connection = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] database.backend               = sqlalchemy {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] database.connection            = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] database.connection_debug      = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] database.connection_parameters =  {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] database.connection_recycle_time = 3600 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] database.connection_trace      = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] database.db_inc_retry_interval = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] database.db_max_retries        = 20 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] database.db_max_retry_interval = 10 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] database.db_retry_interval     = 1 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] database.max_overflow          = 50 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] database.max_pool_size         = 5 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] database.max_retries           = 10 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] database.mysql_wsrep_sync_wait = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] database.pool_timeout          = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] database.retry_interval        = 10 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] database.slave_connection      = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] database.sqlite_synchronous    = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] database.synchronous_reader    = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] database.use_db_reconnect      = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82102) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] profiler.connection_string     = messaging:// {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] profiler.enabled               = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.quobyte [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] profiler.es_doc_type           = notification {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.quobyte [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] profiler.es_scroll_size        = 10000 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] profiler.es_scroll_time        = 2m {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] profiler.filter_error_trace    = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] profiler.hmac_keys             = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] profiler.sentinel_service_name = mymaster {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] Running cmd (subprocess): mount.quobyte {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] profiler.socket_timeout        = 0.1 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] profiler.trace_requests        = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] profiler.trace_sqlalchemy      = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] profiler_jaeger.process_tags   = {} {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] profiler_jaeger.service_name_prefix = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] profiler_otlp.service_name_prefix = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_policy.enforce_new_defaults = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: WARNING oslo_config.cfg [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_policy.enforce_scope      = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_policy.policy_default_rule = default {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_policy.policy_file        = policy.yaml {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] privsep_osbrick.group          = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] privsep_osbrick.helper_command = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] privsep_osbrick.user           = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cinder_sys_admin.group         = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cinder_sys_admin.helper_command = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] cinder_sys_admin.user          = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] service_user.auth_section      = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] service_user.auth_type         = password {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] service_user.cafile            = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] service_user.certfile          = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] service_user.collect_timing    = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] service_user.insecure          = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] service_user.keyfile           = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] service_user.send_service_user_token = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] service_user.split_loggers     = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] service_user.timeout           = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] glance.auth_section            = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] glance.auth_type               = password {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] glance.certfile                = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] glance.collect_timing          = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] glance.insecure                = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] glance.keyfile                 = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] glance.region_name             = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] glance.split_loggers           = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] glance.timeout                 = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.backend_availability_zone = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.chap_password = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.chap_username =  {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.disk_geometry = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.driver_client_cert = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.driver_client_cert_key = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.driver_data_namespace = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.driver_use_ssl = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.extra_capabilities = {} {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.filter_function = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.goodness_function = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.iscsi_target_flags =  {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.iscsi_write_cache = on {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.iser_helper   = tgtadm {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.iser_ip_address = 192.168.122.180 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.iser_port     = 3260 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.nas_host      =  {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.nas_login     = admin {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.nas_mount_options = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.nas_password  = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.nas_private_key =  {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.nas_share_path =  {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.num_shell_tries = 3 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.quobyte_volume_url = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.replication_device = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.report_discard_supported = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.reserved_percentage = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.target_helper = tgtadm {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.target_ip_address = 192.168.122.180 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.target_port   = 3260 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.target_protocol = iscsi {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.trace_flags   = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.unique_fqdn_network = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.use_chap_auth = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.volume_backend_name = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.volume_clear  = zero {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.volume_clear_ionice = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.volume_clear_size = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_reports.file_event_handler = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_reports.log_dir           = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.backend_availability_zone = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.backend_host         = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.chap_password        = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.chap_username        = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.chiscsi_conf         = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.disk_geometry        = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.driver_client_cert   = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.driver_data_namespace = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.driver_use_ssl       = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.extra_capabilities   = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.filter_function      = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.goodness_function    = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.iser_helper          = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.iser_ip_address      = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.iser_port            = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.iser_target_prefix   = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.nas_host             = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.nas_login            = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.nas_mount_options    = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.nas_password         = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.nas_private_key      = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.nas_share_path       = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack quobyte-client[82121]: Reading configuration file: /etc/quobyte/client.cfg
Apr 02 10:24:04 devstack quobyte-client[82121]: Invalid parameters found, error: missing mount point.
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.nas_ssh_port         = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack quobyte-client[82121]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack quobyte-client[82121]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.num_shell_tries      = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.nvmet_port_id        = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.replication_device   = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.report_discard_supported = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.reserved_percentage  = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.scst_target_driver   = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.storage_protocol     = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.target_helper        = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.target_ip_address    = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.target_port          = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.target_prefix        = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.target_protocol      = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.trace_flags          = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.use_chap_auth        = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.volume_clear         = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.volume_clear_size    = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] QuobyteHD.volumes_dir          = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] CMD "mount.quobyte" returned: 1 in 0.065s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.ssl      = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_notifications.driver = [] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_notifications.retry = -1 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] key_manager.fixed_key          = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] barbican.barbican_api_version  = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] barbican.barbican_endpoint     = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] barbican.barbican_endpoint_type = public {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] barbican.barbican_region_name  = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] barbican.cafile                = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] barbican.certfile              = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] barbican.collect_timing        = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] barbican.insecure              = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] barbican.keyfile               = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] barbican.number_of_retries     = 60 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] barbican.retry_delay           = 1 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] barbican.send_service_user_token = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] barbican.split_loggers         = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] barbican.timeout               = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] barbican.verify_ssl            = True {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] barbican.verify_ssl_path       = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] barbican_service_user.auth_section = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] barbican_service_user.auth_type = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] barbican_service_user.cafile   = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] barbican_service_user.certfile = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] barbican_service_user.collect_timing = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] barbican_service_user.insecure = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] barbican_service_user.keyfile  = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] barbican_service_user.split_loggers = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] barbican_service_user.timeout  = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] vault.approle_role_id          = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] vault.approle_secret_id        = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] vault.kv_mountpoint            = secret {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack sudo[82130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] vault.kv_path                  = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] vault.kv_version               = 2 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] vault.namespace                = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack sudo[82130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] vault.root_token_id            = **** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] vault.ssl_ca_crt_file          = None {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] vault.timeout                  = 60.0 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] vault.use_ssl                  = False {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 02 10:24:04 devstack cinder-volume[81916]: DEBUG oslo_service.backend._eventlet.service [None req-4159573c-3350-4cc4-8c2d-f724bf712588 None None] ******************************************************************************** {{(pid=81916) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 02 10:24:04 devstack sudo[82130]: pam_unix(sudo:session): session closed for user root
Apr 02 10:24:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.433s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:24:04 devstack cinder-volume[82102]: INFO cinder.volume.driver [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] Driver hasn't implemented _init_vendor_properties()
Apr 02 10:24:04 devstack cinder-volume[82102]: DEBUG cinder.volume.driver [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757984161377, 'free_capacity_gb': 1775.757984161377, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82102) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 02 10:24:04 devstack cinder-volume[82102]: DEBUG oslo_db.sqlalchemy.engines [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82102) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 02 10:24:04 devstack cinder-volume[82102]: DEBUG dbcounter [-] [82102] Writer thread running {{(pid=82102) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 02 10:24:04 devstack cinder-volume[82102]: DEBUG cinder.db.sqlalchemy.api [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] Building query based on filter {{(pid=82102) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 02 10:24:04 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82102) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 02 10:24:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:24:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:24:04 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:24:04 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:24:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:24:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:24:04 devstack cinder-volume[82102]: INFO cinder.keymgr.migration [None req-161f0ac2-9d03-40fa-88bd-8ce0681f9c53 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 02 10:24:04 devstack sudo[82152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:24:04 devstack sudo[82152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:24:05 devstack sudo[82152]: pam_unix(sudo:session): session closed for user root
Apr 02 10:24:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.495s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:24:05 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:24:05 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] Driver initialization completed successfully.
Apr 02 10:24:05 devstack cinder-volume[82102]: INFO cinder.manager [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] Initiating service 3 cleanup
Apr 02 10:24:05 devstack cinder-volume[82102]: INFO cinder.manager [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] Service 3 cleanup completed.
Apr 02 10:24:05 devstack cinder-volume[82102]: DEBUG cinder.service [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] Creating RPC server for service cinder-volume {{(pid=82102) start /opt/stack/cinder/cinder/service.py:231}}
Apr 02 10:24:05 devstack cinder-volume[82102]: DEBUG cinder.service [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82102) start /opt/stack/cinder/cinder/service.py:237}}
Apr 02 10:24:05 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 02 10:24:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:24:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:24:05 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:24:05 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:24:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:24:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:24:05 devstack sudo[82162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:24:05 devstack sudo[82162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:24:05 devstack sudo[82162]: pam_unix(sudo:session): session closed for user root
Apr 02 10:24:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.390s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:24:05 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-84f68dcd-c50e-4aed-b072-b44e0277dc97 None None] Driver post RPC initialization completed successfully.
Apr 02 10:24:13 devstack cinder-volume[81916]: DEBUG dbcounter [-] [81916] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81916) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 02 10:24:15 devstack cinder-volume[82102]: DEBUG dbcounter [-] [82102] Writing DB stats cinder:SELECT=2 {{(pid=82102) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 02 10:24:15 devstack cinder-volume[82102]: DEBUG dbcounter [-] [82102] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=82102) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 02 10:25:01 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [req-8362c348-fc73-44c2-ac07-2d953f5ed314 req-f38b2239-8ccf-4782-9881-e33b828095ea tempest-VolumesGetTestJSON-608833226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:25:02 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-8362c348-fc73-44c2-ac07-2d953f5ed314 req-f38b2239-8ccf-4782-9881-e33b828095ea tempest-VolumesGetTestJSON-608833226 None] Flow 'volume_create_manager' (47f09d9e-5ccf-4431-8c3c-bcfaf2bb1dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:25:02 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-8362c348-fc73-44c2-ac07-2d953f5ed314 req-f38b2239-8ccf-4782-9881-e33b828095ea tempest-VolumesGetTestJSON-608833226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dda76a03-7910-4f34-8b64-a093e6486f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:25:02 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-8362c348-fc73-44c2-ac07-2d953f5ed314 req-f38b2239-8ccf-4782-9881-e33b828095ea tempest-VolumesGetTestJSON-608833226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dda76a03-7910-4f34-8b64-a093e6486f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-357506606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d6ef902-3fdc-448a-9d7e-c5b8bc1910af,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='456e56c28a954a23baf4fcffc3d360b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:25:02Z,use_quota=True,user_id='f915b44d51a64698aab973b0c0e26219',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:25:02 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-8362c348-fc73-44c2-ac07-2d953f5ed314 req-f38b2239-8ccf-4782-9881-e33b828095ea tempest-VolumesGetTestJSON-608833226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (878353f8-1a0d-4eb5-887d-e68211d12129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:25:02 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-8362c348-fc73-44c2-ac07-2d953f5ed314 req-f38b2239-8ccf-4782-9881-e33b828095ea tempest-VolumesGetTestJSON-608833226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (878353f8-1a0d-4eb5-887d-e68211d12129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:25:02 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-8362c348-fc73-44c2-ac07-2d953f5ed314 req-f38b2239-8ccf-4782-9881-e33b828095ea tempest-VolumesGetTestJSON-608833226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f9b7d05-5550-4486-bf39-d51815c84191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:25:02 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-8362c348-fc73-44c2-ac07-2d953f5ed314 req-f38b2239-8ccf-4782-9881-e33b828095ea tempest-VolumesGetTestJSON-608833226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f9b7d05-5550-4486-bf39-d51815c84191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d6ef902-3fdc-448a-9d7e-c5b8bc1910af', 'volume_name': 'volume-1d6ef902-3fdc-448a-9d7e-c5b8bc1910af', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:25:02 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-8362c348-fc73-44c2-ac07-2d953f5ed314 req-f38b2239-8ccf-4782-9881-e33b828095ea tempest-VolumesGetTestJSON-608833226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e81ce09-24c6-4a4f-9c67-0ac5c2b54733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:25:02 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-8362c348-fc73-44c2-ac07-2d953f5ed314 req-f38b2239-8ccf-4782-9881-e33b828095ea tempest-VolumesGetTestJSON-608833226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e81ce09-24c6-4a4f-9c67-0ac5c2b54733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:25:02 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-8362c348-fc73-44c2-ac07-2d953f5ed314 req-f38b2239-8ccf-4782-9881-e33b828095ea tempest-VolumesGetTestJSON-608833226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b622c2-f11f-4ca9-9483-b41504ecdac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:25:02 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [req-8362c348-fc73-44c2-ac07-2d953f5ed314 req-f38b2239-8ccf-4782-9881-e33b828095ea tempest-VolumesGetTestJSON-608833226 None] Volume 1d6ef902-3fdc-448a-9d7e-c5b8bc1910af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d6ef902-3fdc-448a-9d7e-c5b8bc1910af', 'volume_size': 1}
Apr 02 10:25:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-8362c348-fc73-44c2-ac07-2d953f5ed314 req-f38b2239-8ccf-4782-9881-e33b828095ea tempest-VolumesGetTestJSON-608833226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:25:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-8362c348-fc73-44c2-ac07-2d953f5ed314 req-f38b2239-8ccf-4782-9881-e33b828095ea tempest-VolumesGetTestJSON-608833226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:25:02 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [req-8362c348-fc73-44c2-ac07-2d953f5ed314 req-f38b2239-8ccf-4782-9881-e33b828095ea tempest-VolumesGetTestJSON-608833226 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-357506606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d6ef902-3fdc-448a-9d7e-c5b8bc1910af,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='456e56c28a954a23baf4fcffc3d360b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:25:02Z,use_quota=True,user_id='f915b44d51a64698aab973b0c0e26219',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:25:02 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [req-8362c348-fc73-44c2-ac07-2d953f5ed314 req-f38b2239-8ccf-4782-9881-e33b828095ea tempest-VolumesGetTestJSON-608833226 None] Creating volume 1d6ef902-3fdc-448a-9d7e-c5b8bc1910af {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:25:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-8362c348-fc73-44c2-ac07-2d953f5ed314 req-f38b2239-8ccf-4782-9881-e33b828095ea tempest-VolumesGetTestJSON-608833226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:25:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-8362c348-fc73-44c2-ac07-2d953f5ed314 req-f38b2239-8ccf-4782-9881-e33b828095ea tempest-VolumesGetTestJSON-608833226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:25:02 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [req-8362c348-fc73-44c2-ac07-2d953f5ed314 req-f38b2239-8ccf-4782-9881-e33b828095ea tempest-VolumesGetTestJSON-608833226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:25:02 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [req-8362c348-fc73-44c2-ac07-2d953f5ed314 req-f38b2239-8ccf-4782-9881-e33b828095ea tempest-VolumesGetTestJSON-608833226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:25:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-8362c348-fc73-44c2-ac07-2d953f5ed314 req-f38b2239-8ccf-4782-9881-e33b828095ea tempest-VolumesGetTestJSON-608833226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:25:02 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [req-8362c348-fc73-44c2-ac07-2d953f5ed314 req-f38b2239-8ccf-4782-9881-e33b828095ea tempest-VolumesGetTestJSON-608833226 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:25:02 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [req-8362c348-fc73-44c2-ac07-2d953f5ed314 req-f38b2239-8ccf-4782-9881-e33b828095ea tempest-VolumesGetTestJSON-608833226 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:25:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-8362c348-fc73-44c2-ac07-2d953f5ed314 req-f38b2239-8ccf-4782-9881-e33b828095ea tempest-VolumesGetTestJSON-608833226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-1d6ef902-3fdc-448a-9d7e-c5b8bc1910af 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:25:02 devstack sudo[82505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-1d6ef902-3fdc-448a-9d7e-c5b8bc1910af 1073741824
Apr 02 10:25:02 devstack sudo[82505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:25:04 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c9a6907-ef2b-40e9-80d4-3b38ac60be94 tempest-VolumesAdminNegativeTest-1199109128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:25:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-0c9a6907-ef2b-40e9-80d4-3b38ac60be94 tempest-VolumesAdminNegativeTest-1199109128 None] Flow 'volume_create_manager' (3ba4c426-c2f1-4022-aa7f-0a3341b83195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:25:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-0c9a6907-ef2b-40e9-80d4-3b38ac60be94 tempest-VolumesAdminNegativeTest-1199109128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05b6c210-4237-49bb-a0ed-4299a8ad43bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:25:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-0c9a6907-ef2b-40e9-80d4-3b38ac60be94 tempest-VolumesAdminNegativeTest-1199109128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05b6c210-4237-49bb-a0ed-4299a8ad43bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1178086671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92388bec-cedd-4ca9-95a3-523dff28c14d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db85d30465584ad8994a729f86e3be1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:25:04Z,use_quota=True,user_id='a8102b5988894cdaa98fc97681f6603d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:25:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-0c9a6907-ef2b-40e9-80d4-3b38ac60be94 tempest-VolumesAdminNegativeTest-1199109128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (054a66e3-14f3-4ddc-9417-d2bb34002410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:25:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-0c9a6907-ef2b-40e9-80d4-3b38ac60be94 tempest-VolumesAdminNegativeTest-1199109128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (054a66e3-14f3-4ddc-9417-d2bb34002410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:25:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-0c9a6907-ef2b-40e9-80d4-3b38ac60be94 tempest-VolumesAdminNegativeTest-1199109128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5a85b09-9379-4140-8729-eec94d3fb982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:25:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-0c9a6907-ef2b-40e9-80d4-3b38ac60be94 tempest-VolumesAdminNegativeTest-1199109128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5a85b09-9379-4140-8729-eec94d3fb982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92388bec-cedd-4ca9-95a3-523dff28c14d', 'volume_name': 'volume-92388bec-cedd-4ca9-95a3-523dff28c14d', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:25:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-0c9a6907-ef2b-40e9-80d4-3b38ac60be94 tempest-VolumesAdminNegativeTest-1199109128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97bdce5c-2bac-40eb-aa27-ee806b88f829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:25:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-0c9a6907-ef2b-40e9-80d4-3b38ac60be94 tempest-VolumesAdminNegativeTest-1199109128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97bdce5c-2bac-40eb-aa27-ee806b88f829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:25:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-0c9a6907-ef2b-40e9-80d4-3b38ac60be94 tempest-VolumesAdminNegativeTest-1199109128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d594518-1595-4f78-882a-1665288a27bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:25:04 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-0c9a6907-ef2b-40e9-80d4-3b38ac60be94 tempest-VolumesAdminNegativeTest-1199109128 None] Volume 92388bec-cedd-4ca9-95a3-523dff28c14d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92388bec-cedd-4ca9-95a3-523dff28c14d', 'volume_size': 1}
Apr 02 10:25:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-0c9a6907-ef2b-40e9-80d4-3b38ac60be94 tempest-VolumesAdminNegativeTest-1199109128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:25:04 devstack sudo[82505]: pam_unix(sudo:session): session closed for user root
Apr 02 10:25:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-8362c348-fc73-44c2-ac07-2d953f5ed314 req-f38b2239-8ccf-4782-9881-e33b828095ea tempest-VolumesGetTestJSON-608833226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-1d6ef902-3fdc-448a-9d7e-c5b8bc1910af 1073741824" returned: 0 in 2.073s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:25:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-8362c348-fc73-44c2-ac07-2d953f5ed314 req-f38b2239-8ccf-4782-9881-e33b828095ea tempest-VolumesGetTestJSON-608833226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-1d6ef902-3fdc-448a-9d7e-c5b8bc1910af {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:25:04 devstack sudo[82825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-1d6ef902-3fdc-448a-9d7e-c5b8bc1910af
Apr 02 10:25:04 devstack sudo[82825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:25:05 devstack sudo[82825]: pam_unix(sudo:session): session closed for user root
Apr 02 10:25:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-8362c348-fc73-44c2-ac07-2d953f5ed314 req-f38b2239-8ccf-4782-9881-e33b828095ea tempest-VolumesGetTestJSON-608833226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-1d6ef902-3fdc-448a-9d7e-c5b8bc1910af" returned: 0 in 0.684s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:25:05 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [req-8362c348-fc73-44c2-ac07-2d953f5ed314 req-f38b2239-8ccf-4782-9881-e33b828095ea tempest-VolumesGetTestJSON-608833226 None] <== create_volume: return (2879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:25:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-8362c348-fc73-44c2-ac07-2d953f5ed314 req-f38b2239-8ccf-4782-9881-e33b828095ea tempest-VolumesGetTestJSON-608833226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.882s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:25:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-0c9a6907-ef2b-40e9-80d4-3b38ac60be94 tempest-VolumesAdminNegativeTest-1199109128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.104s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:25:05 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-0c9a6907-ef2b-40e9-80d4-3b38ac60be94 tempest-VolumesAdminNegativeTest-1199109128 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1178086671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92388bec-cedd-4ca9-95a3-523dff28c14d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db85d30465584ad8994a729f86e3be1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:25:04Z,use_quota=True,user_id='a8102b5988894cdaa98fc97681f6603d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:25:05 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-0c9a6907-ef2b-40e9-80d4-3b38ac60be94 tempest-VolumesAdminNegativeTest-1199109128 None] Creating volume 92388bec-cedd-4ca9-95a3-523dff28c14d {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:25:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-0c9a6907-ef2b-40e9-80d4-3b38ac60be94 tempest-VolumesAdminNegativeTest-1199109128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:25:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-0c9a6907-ef2b-40e9-80d4-3b38ac60be94 tempest-VolumesAdminNegativeTest-1199109128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:25:05 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-0c9a6907-ef2b-40e9-80d4-3b38ac60be94 tempest-VolumesAdminNegativeTest-1199109128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:25:05 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-0c9a6907-ef2b-40e9-80d4-3b38ac60be94 tempest-VolumesAdminNegativeTest-1199109128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:25:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-0c9a6907-ef2b-40e9-80d4-3b38ac60be94 tempest-VolumesAdminNegativeTest-1199109128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:25:05 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-0c9a6907-ef2b-40e9-80d4-3b38ac60be94 tempest-VolumesAdminNegativeTest-1199109128 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:25:05 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-0c9a6907-ef2b-40e9-80d4-3b38ac60be94 tempest-VolumesAdminNegativeTest-1199109128 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:25:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0c9a6907-ef2b-40e9-80d4-3b38ac60be94 tempest-VolumesAdminNegativeTest-1199109128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-92388bec-cedd-4ca9-95a3-523dff28c14d 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:25:05 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-8362c348-fc73-44c2-ac07-2d953f5ed314 req-f38b2239-8ccf-4782-9881-e33b828095ea tempest-VolumesGetTestJSON-608833226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b622c2-f11f-4ca9-9483-b41504ecdac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d6ef902-3fdc-448a-9d7e-c5b8bc1910af', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:25:05 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-8362c348-fc73-44c2-ac07-2d953f5ed314 req-f38b2239-8ccf-4782-9881-e33b828095ea tempest-VolumesGetTestJSON-608833226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7031c28b-ceb4-488e-bce4-a13fc30c5a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:25:05 devstack sudo[82830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-92388bec-cedd-4ca9-95a3-523dff28c14d 1073741824
Apr 02 10:25:05 devstack sudo[82830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:25:05 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [req-8362c348-fc73-44c2-ac07-2d953f5ed314 req-f38b2239-8ccf-4782-9881-e33b828095ea tempest-VolumesGetTestJSON-608833226 None] Volume volume-1d6ef902-3fdc-448a-9d7e-c5b8bc1910af (1d6ef902-3fdc-448a-9d7e-c5b8bc1910af): created successfully
Apr 02 10:25:05 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-8362c348-fc73-44c2-ac07-2d953f5ed314 req-f38b2239-8ccf-4782-9881-e33b828095ea tempest-VolumesGetTestJSON-608833226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7031c28b-ceb4-488e-bce4-a13fc30c5a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:25:05 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-8362c348-fc73-44c2-ac07-2d953f5ed314 req-f38b2239-8ccf-4782-9881-e33b828095ea tempest-VolumesGetTestJSON-608833226 None] Flow 'volume_create_manager' (47f09d9e-5ccf-4431-8c3c-bcfaf2bb1dd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:25:05 devstack cinder-volume[82102]: INFO cinder.volume.manager [req-8362c348-fc73-44c2-ac07-2d953f5ed314 req-f38b2239-8ccf-4782-9881-e33b828095ea tempest-VolumesGetTestJSON-608833226 None] Created volume successfully.
Apr 02 10:25:06 devstack cinder-volume[82102]: DEBUG cinder.coordination [req-c1bfaed4-afb6-44de-8525-1a19a75f678d req-bab6efd9-e442-4696-bf33-45297e975067 tempest-VolumesGetTestJSON-608833226 None] Acquiring lock "cinder-1d6ef902-3fdc-448a-9d7e-c5b8bc1910af-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:25:06 devstack cinder-volume[82102]: DEBUG cinder.coordination [req-c1bfaed4-afb6-44de-8525-1a19a75f678d req-bab6efd9-e442-4696-bf33-45297e975067 tempest-VolumesGetTestJSON-608833226 None] Lock "cinder-1d6ef902-3fdc-448a-9d7e-c5b8bc1910af-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:25:06 devstack sudo[82830]: pam_unix(sudo:session): session closed for user root
Apr 02 10:25:06 devstack cinder-volume[82102]: DEBUG cinder.coordination [req-c1bfaed4-afb6-44de-8525-1a19a75f678d req-bab6efd9-e442-4696-bf33-45297e975067 tempest-VolumesGetTestJSON-608833226 None] Acquiring lock "cinder-quobyte-1d6ef902-3fdc-448a-9d7e-c5b8bc1910af" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:25:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0c9a6907-ef2b-40e9-80d4-3b38ac60be94 tempest-VolumesAdminNegativeTest-1199109128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-92388bec-cedd-4ca9-95a3-523dff28c14d 1073741824" returned: 0 in 1.627s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:25:07 devstack cinder-volume[82102]: DEBUG cinder.coordination [req-c1bfaed4-afb6-44de-8525-1a19a75f678d req-bab6efd9-e442-4696-bf33-45297e975067 tempest-VolumesGetTestJSON-608833226 None] Lock "cinder-quobyte-1d6ef902-3fdc-448a-9d7e-c5b8bc1910af" acquired by "delete_volume" :: waited 0.017s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:25:07 devstack cinder-volume[82102]: INFO oslo.privsep.daemon [req-c1bfaed4-afb6-44de-8525-1a19a75f678d req-bab6efd9-e442-4696-bf33-45297e975067 tempest-VolumesGetTestJSON-608833226 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmplnuqblw6/privsep.sock']
Apr 02 10:25:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0c9a6907-ef2b-40e9-80d4-3b38ac60be94 tempest-VolumesAdminNegativeTest-1199109128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-92388bec-cedd-4ca9-95a3-523dff28c14d {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:25:07 devstack sudo[83007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmplnuqblw6/privsep.sock
Apr 02 10:25:07 devstack sudo[83007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:25:07 devstack sudo[83009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-92388bec-cedd-4ca9-95a3-523dff28c14d
Apr 02 10:25:07 devstack sudo[83009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:25:07 devstack sudo[83009]: pam_unix(sudo:session): session closed for user root
Apr 02 10:25:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0c9a6907-ef2b-40e9-80d4-3b38ac60be94 tempest-VolumesAdminNegativeTest-1199109128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-92388bec-cedd-4ca9-95a3-523dff28c14d" returned: 0 in 0.795s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:25:07 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-0c9a6907-ef2b-40e9-80d4-3b38ac60be94 tempest-VolumesAdminNegativeTest-1199109128 None] <== create_volume: return (2515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:25:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-0c9a6907-ef2b-40e9-80d4-3b38ac60be94 tempest-VolumesAdminNegativeTest-1199109128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.519s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:25:07 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-0c9a6907-ef2b-40e9-80d4-3b38ac60be94 tempest-VolumesAdminNegativeTest-1199109128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d594518-1595-4f78-882a-1665288a27bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92388bec-cedd-4ca9-95a3-523dff28c14d', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:25:07 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-0c9a6907-ef2b-40e9-80d4-3b38ac60be94 tempest-VolumesAdminNegativeTest-1199109128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47c5996-aee1-4047-8cf8-275837112018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:25:07 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-0c9a6907-ef2b-40e9-80d4-3b38ac60be94 tempest-VolumesAdminNegativeTest-1199109128 None] Volume volume-92388bec-cedd-4ca9-95a3-523dff28c14d (92388bec-cedd-4ca9-95a3-523dff28c14d): created successfully
Apr 02 10:25:07 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-0c9a6907-ef2b-40e9-80d4-3b38ac60be94 tempest-VolumesAdminNegativeTest-1199109128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47c5996-aee1-4047-8cf8-275837112018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:25:07 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-0c9a6907-ef2b-40e9-80d4-3b38ac60be94 tempest-VolumesAdminNegativeTest-1199109128 None] Flow 'volume_create_manager' (3ba4c426-c2f1-4022-aa7f-0a3341b83195) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:25:07 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-0c9a6907-ef2b-40e9-80d4-3b38ac60be94 tempest-VolumesAdminNegativeTest-1199109128 None] Created volume successfully.
Apr 02 10:25:08 devstack cinder-volume[82102]: DEBUG oslo_service.periodic_task [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 02 10:25:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:25:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:25:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:25:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:25:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:25:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:25:08 devstack sudo[83014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:25:08 devstack sudo[83014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:25:09 devstack sudo[83007]: pam_unix(sudo:session): session closed for user root
Apr 02 10:25:09 devstack cinder-volume[82102]: INFO oslo.privsep.daemon [req-c1bfaed4-afb6-44de-8525-1a19a75f678d req-bab6efd9-e442-4696-bf33-45297e975067 tempest-VolumesGetTestJSON-608833226 None] Spawned new privsep daemon via rootwrap
Apr 02 10:25:09 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [req-c1bfaed4-afb6-44de-8525-1a19a75f678d req-bab6efd9-e442-4696-bf33-45297e975067 tempest-VolumesGetTestJSON-608833226 None] Accepted privsep connection to /tmp/tmplnuqblw6/privsep.sock {{(pid=82102) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Apr 02 10:25:09 devstack cinder-volume[82102]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 02 10:25:09 devstack cinder-volume[82102]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 02 10:25:09 devstack cinder-volume[82102]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 02 10:25:09 devstack cinder-volume[82102]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83013
Apr 02 10:25:09 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd8c274-b8dc-4129-a65c-efd4bf0fd207]: (2,) {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:25:09 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0532cbe-e2cb-490d-b34c-742026400de8]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:25:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-c1bfaed4-afb6-44de-8525-1a19a75f678d req-bab6efd9-e442-4696-bf33-45297e975067 tempest-VolumesGetTestJSON-608833226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-1d6ef902-3fdc-448a-9d7e-c5b8bc1910af {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:25:09 devstack sudo[83017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-1d6ef902-3fdc-448a-9d7e-c5b8bc1910af
Apr 02 10:25:09 devstack sudo[83017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:25:09 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-bcdb013d-9804-4545-8aca-304a184203eb tempest-VolumesAdminNegativeTest-1199109128 None] Acquiring lock "cinder-92388bec-cedd-4ca9-95a3-523dff28c14d-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:25:09 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-bcdb013d-9804-4545-8aca-304a184203eb tempest-VolumesAdminNegativeTest-1199109128 None] Lock "cinder-92388bec-cedd-4ca9-95a3-523dff28c14d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:25:09 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-bcdb013d-9804-4545-8aca-304a184203eb tempest-VolumesAdminNegativeTest-1199109128 None] Acquiring lock "cinder-quobyte-92388bec-cedd-4ca9-95a3-523dff28c14d" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:25:09 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-bcdb013d-9804-4545-8aca-304a184203eb tempest-VolumesAdminNegativeTest-1199109128 None] Lock "cinder-quobyte-92388bec-cedd-4ca9-95a3-523dff28c14d" acquired by "delete_volume" :: waited 0.040s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:25:09 devstack sudo[83014]: pam_unix(sudo:session): session closed for user root
Apr 02 10:25:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 1.202s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:25:09 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:25:09 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51c8ce4-9837-4dc9-a165-95e1c66996cc]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:25:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bcdb013d-9804-4545-8aca-304a184203eb tempest-VolumesAdminNegativeTest-1199109128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-92388bec-cedd-4ca9-95a3-523dff28c14d {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:25:10 devstack sudo[83020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-92388bec-cedd-4ca9-95a3-523dff28c14d
Apr 02 10:25:10 devstack sudo[83020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:25:10 devstack sudo[83017]: pam_unix(sudo:session): session closed for user root
Apr 02 10:25:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-c1bfaed4-afb6-44de-8525-1a19a75f678d req-bab6efd9-e442-4696-bf33-45297e975067 tempest-VolumesGetTestJSON-608833226 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-1d6ef902-3fdc-448a-9d7e-c5b8bc1910af" returned: 0 in 1.103s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:25:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-c1bfaed4-afb6-44de-8525-1a19a75f678d req-bab6efd9-e442-4696-bf33-45297e975067 tempest-VolumesGetTestJSON-608833226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-1d6ef902-3fdc-448a-9d7e-c5b8bc1910af {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:25:10 devstack sudo[83025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-1d6ef902-3fdc-448a-9d7e-c5b8bc1910af
Apr 02 10:25:10 devstack sudo[83025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:25:11 devstack sudo[83020]: pam_unix(sudo:session): session closed for user root
Apr 02 10:25:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bcdb013d-9804-4545-8aca-304a184203eb tempest-VolumesAdminNegativeTest-1199109128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-92388bec-cedd-4ca9-95a3-523dff28c14d" returned: 0 in 1.797s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:25:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bcdb013d-9804-4545-8aca-304a184203eb tempest-VolumesAdminNegativeTest-1199109128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-92388bec-cedd-4ca9-95a3-523dff28c14d {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:25:11 devstack sudo[83147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-92388bec-cedd-4ca9-95a3-523dff28c14d
Apr 02 10:25:11 devstack sudo[83147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:25:11 devstack sudo[83025]: pam_unix(sudo:session): session closed for user root
Apr 02 10:25:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-c1bfaed4-afb6-44de-8525-1a19a75f678d req-bab6efd9-e442-4696-bf33-45297e975067 tempest-VolumesGetTestJSON-608833226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-1d6ef902-3fdc-448a-9d7e-c5b8bc1910af" returned: 0 in 1.598s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:25:11 devstack cinder-volume[82102]: DEBUG cinder.coordination [req-c1bfaed4-afb6-44de-8525-1a19a75f678d req-bab6efd9-e442-4696-bf33-45297e975067 tempest-VolumesGetTestJSON-608833226 None] Lock "cinder-quobyte-1d6ef902-3fdc-448a-9d7e-c5b8bc1910af" released by "delete_volume" :: held 4.964s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:25:12 devstack cinder-volume[82102]: WARNING cinder.quota [req-c1bfaed4-afb6-44de-8525-1a19a75f678d req-bab6efd9-e442-4696-bf33-45297e975067 tempest-VolumesGetTestJSON-608833226 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 02 10:25:12 devstack cinder-volume[82102]: WARNING cinder.quota [req-c1bfaed4-afb6-44de-8525-1a19a75f678d req-bab6efd9-e442-4696-bf33-45297e975067 tempest-VolumesGetTestJSON-608833226 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 02 10:25:12 devstack cinder-volume[82102]: DEBUG cinder.quota [req-c1bfaed4-afb6-44de-8525-1a19a75f678d req-bab6efd9-e442-4696-bf33-45297e975067 tempest-VolumesGetTestJSON-608833226 None] Created reservations ['0270ec24-7067-4b96-a99f-8fcc7dcae01f', '1bc71849-3f06-4b94-9dd3-868fafe341c0', 'a5ebae29-05ad-4b6c-bbca-ebaa604f002f', '0eba7904-b1fa-4338-9fd4-ef53c583fcf4'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:25:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-c1bfaed4-afb6-44de-8525-1a19a75f678d req-bab6efd9-e442-4696-bf33-45297e975067 tempest-VolumesGetTestJSON-608833226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:25:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-c1bfaed4-afb6-44de-8525-1a19a75f678d req-bab6efd9-e442-4696-bf33-45297e975067 tempest-VolumesGetTestJSON-608833226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:25:12 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [req-c1bfaed4-afb6-44de-8525-1a19a75f678d req-bab6efd9-e442-4696-bf33-45297e975067 tempest-VolumesGetTestJSON-608833226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:25:12 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [req-c1bfaed4-afb6-44de-8525-1a19a75f678d req-bab6efd9-e442-4696-bf33-45297e975067 tempest-VolumesGetTestJSON-608833226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:25:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-c1bfaed4-afb6-44de-8525-1a19a75f678d req-bab6efd9-e442-4696-bf33-45297e975067 tempest-VolumesGetTestJSON-608833226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:25:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-c1bfaed4-afb6-44de-8525-1a19a75f678d req-bab6efd9-e442-4696-bf33-45297e975067 tempest-VolumesGetTestJSON-608833226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:25:12 devstack sudo[83150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:25:12 devstack sudo[83150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:25:13 devstack sudo[83147]: pam_unix(sudo:session): session closed for user root
Apr 02 10:25:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bcdb013d-9804-4545-8aca-304a184203eb tempest-VolumesAdminNegativeTest-1199109128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-92388bec-cedd-4ca9-95a3-523dff28c14d" returned: 0 in 1.335s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:25:13 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-bcdb013d-9804-4545-8aca-304a184203eb tempest-VolumesAdminNegativeTest-1199109128 None] Lock "cinder-quobyte-92388bec-cedd-4ca9-95a3-523dff28c14d" released by "delete_volume" :: held 3.203s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:25:13 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-bcdb013d-9804-4545-8aca-304a184203eb tempest-VolumesAdminNegativeTest-1199109128 None] Created reservations ['4c11e540-a31c-45b5-a964-0a5b2cb14bd7', '6b1d852f-7195-4c4f-bd7f-52a516f744a9', '71f5195d-5b2b-4cdf-9ab5-e4fc4b138c7b', 'ba52accf-51ec-45a0-b305-4ef14ae1abf5'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:25:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bcdb013d-9804-4545-8aca-304a184203eb tempest-VolumesAdminNegativeTest-1199109128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:25:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bcdb013d-9804-4545-8aca-304a184203eb tempest-VolumesAdminNegativeTest-1199109128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:25:13 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-bcdb013d-9804-4545-8aca-304a184203eb tempest-VolumesAdminNegativeTest-1199109128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:25:13 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-bcdb013d-9804-4545-8aca-304a184203eb tempest-VolumesAdminNegativeTest-1199109128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:25:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bcdb013d-9804-4545-8aca-304a184203eb tempest-VolumesAdminNegativeTest-1199109128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:25:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bcdb013d-9804-4545-8aca-304a184203eb tempest-VolumesAdminNegativeTest-1199109128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:25:13 devstack sudo[83153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:25:13 devstack sudo[83153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:25:13 devstack sudo[83150]: pam_unix(sudo:session): session closed for user root
Apr 02 10:25:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-c1bfaed4-afb6-44de-8525-1a19a75f678d req-bab6efd9-e442-4696-bf33-45297e975067 tempest-VolumesGetTestJSON-608833226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 1.112s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:25:13 devstack cinder-volume[82102]: DEBUG cinder.manager [req-c1bfaed4-afb6-44de-8525-1a19a75f678d req-bab6efd9-e442-4696-bf33-45297e975067 tempest-VolumesGetTestJSON-608833226 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:25:13 devstack cinder-volume[82102]: INFO cinder.volume.manager [req-c1bfaed4-afb6-44de-8525-1a19a75f678d req-bab6efd9-e442-4696-bf33-45297e975067 tempest-VolumesGetTestJSON-608833226 None] Deleted volume successfully.
Apr 02 10:25:13 devstack cinder-volume[82102]: DEBUG cinder.coordination [req-c1bfaed4-afb6-44de-8525-1a19a75f678d req-bab6efd9-e442-4696-bf33-45297e975067 tempest-VolumesGetTestJSON-608833226 None] Lock "cinder-1d6ef902-3fdc-448a-9d7e-c5b8bc1910af-delete_volume" released by "delete_volume" :: held 6.693s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:25:14 devstack sudo[83153]: pam_unix(sudo:session): session closed for user root
Apr 02 10:25:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bcdb013d-9804-4545-8aca-304a184203eb tempest-VolumesAdminNegativeTest-1199109128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 1.116s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:25:14 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-bcdb013d-9804-4545-8aca-304a184203eb tempest-VolumesAdminNegativeTest-1199109128 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:25:14 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-bcdb013d-9804-4545-8aca-304a184203eb tempest-VolumesAdminNegativeTest-1199109128 None] Deleted volume successfully.
Apr 02 10:25:14 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-bcdb013d-9804-4545-8aca-304a184203eb tempest-VolumesAdminNegativeTest-1199109128 None] Lock "cinder-92388bec-cedd-4ca9-95a3-523dff28c14d-delete_volume" released by "delete_volume" :: held 4.640s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:25:15 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-d699043d-fcf7-425b-b0fe-3c54bcdb4f81 tempest-ServerRescueNegativeTestJSON-1290777604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:25:15 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d699043d-fcf7-425b-b0fe-3c54bcdb4f81 tempest-ServerRescueNegativeTestJSON-1290777604 None] Flow 'volume_create_manager' (5e4c9a53-0d28-4f62-92db-8ae6f2f581c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:25:15 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d699043d-fcf7-425b-b0fe-3c54bcdb4f81 tempest-ServerRescueNegativeTestJSON-1290777604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3ce938-00c1-4323-ba33-2c6d6eabe75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:25:15 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d699043d-fcf7-425b-b0fe-3c54bcdb4f81 tempest-ServerRescueNegativeTestJSON-1290777604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3ce938-00c1-4323-ba33-2c6d6eabe75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1423222881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f2a7204-de11-43fa-9a50-9371ddeea6a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5104d2c53c2a4c739803ee9358f460ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:25:15Z,use_quota=True,user_id='233aae95a81d47409843db43f9ed32c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:25:15 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d699043d-fcf7-425b-b0fe-3c54bcdb4f81 tempest-ServerRescueNegativeTestJSON-1290777604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51469f05-4834-4cfd-8027-896cf08b5661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:25:15 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d699043d-fcf7-425b-b0fe-3c54bcdb4f81 tempest-ServerRescueNegativeTestJSON-1290777604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51469f05-4834-4cfd-8027-896cf08b5661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:25:15 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d699043d-fcf7-425b-b0fe-3c54bcdb4f81 tempest-ServerRescueNegativeTestJSON-1290777604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6529a7b3-3412-441f-815e-c01a6ad39392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:25:15 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d699043d-fcf7-425b-b0fe-3c54bcdb4f81 tempest-ServerRescueNegativeTestJSON-1290777604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6529a7b3-3412-441f-815e-c01a6ad39392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f2a7204-de11-43fa-9a50-9371ddeea6a2', 'volume_name': 'volume-6f2a7204-de11-43fa-9a50-9371ddeea6a2', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:25:15 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d699043d-fcf7-425b-b0fe-3c54bcdb4f81 tempest-ServerRescueNegativeTestJSON-1290777604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca32849-fcb0-4669-8dd7-9a3595966eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:25:15 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d699043d-fcf7-425b-b0fe-3c54bcdb4f81 tempest-ServerRescueNegativeTestJSON-1290777604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca32849-fcb0-4669-8dd7-9a3595966eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:25:15 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d699043d-fcf7-425b-b0fe-3c54bcdb4f81 tempest-ServerRescueNegativeTestJSON-1290777604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aaf4a2e-e8d8-4f98-b3fd-07fea971a028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:25:15 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-d699043d-fcf7-425b-b0fe-3c54bcdb4f81 tempest-ServerRescueNegativeTestJSON-1290777604 None] Volume 6f2a7204-de11-43fa-9a50-9371ddeea6a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f2a7204-de11-43fa-9a50-9371ddeea6a2', 'volume_size': 1}
Apr 02 10:25:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d699043d-fcf7-425b-b0fe-3c54bcdb4f81 tempest-ServerRescueNegativeTestJSON-1290777604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:25:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d699043d-fcf7-425b-b0fe-3c54bcdb4f81 tempest-ServerRescueNegativeTestJSON-1290777604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:25:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d699043d-fcf7-425b-b0fe-3c54bcdb4f81 tempest-ServerRescueNegativeTestJSON-1290777604 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1423222881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f2a7204-de11-43fa-9a50-9371ddeea6a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5104d2c53c2a4c739803ee9358f460ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:25:15Z,use_quota=True,user_id='233aae95a81d47409843db43f9ed32c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:25:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-d699043d-fcf7-425b-b0fe-3c54bcdb4f81 tempest-ServerRescueNegativeTestJSON-1290777604 None] Creating volume 6f2a7204-de11-43fa-9a50-9371ddeea6a2 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:25:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d699043d-fcf7-425b-b0fe-3c54bcdb4f81 tempest-ServerRescueNegativeTestJSON-1290777604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:25:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d699043d-fcf7-425b-b0fe-3c54bcdb4f81 tempest-ServerRescueNegativeTestJSON-1290777604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:25:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d699043d-fcf7-425b-b0fe-3c54bcdb4f81 tempest-ServerRescueNegativeTestJSON-1290777604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:25:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d699043d-fcf7-425b-b0fe-3c54bcdb4f81 tempest-ServerRescueNegativeTestJSON-1290777604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:25:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d699043d-fcf7-425b-b0fe-3c54bcdb4f81 tempest-ServerRescueNegativeTestJSON-1290777604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:25:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d699043d-fcf7-425b-b0fe-3c54bcdb4f81 tempest-ServerRescueNegativeTestJSON-1290777604 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:25:15 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-d699043d-fcf7-425b-b0fe-3c54bcdb4f81 tempest-ServerRescueNegativeTestJSON-1290777604 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:25:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d699043d-fcf7-425b-b0fe-3c54bcdb4f81 tempest-ServerRescueNegativeTestJSON-1290777604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6f2a7204-de11-43fa-9a50-9371ddeea6a2 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:25:15 devstack sudo[83181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6f2a7204-de11-43fa-9a50-9371ddeea6a2 1073741824
Apr 02 10:25:15 devstack sudo[83181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:25:16 devstack sudo[83181]: pam_unix(sudo:session): session closed for user root
Apr 02 10:25:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d699043d-fcf7-425b-b0fe-3c54bcdb4f81 tempest-ServerRescueNegativeTestJSON-1290777604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6f2a7204-de11-43fa-9a50-9371ddeea6a2 1073741824" returned: 0 in 0.749s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:25:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d699043d-fcf7-425b-b0fe-3c54bcdb4f81 tempest-ServerRescueNegativeTestJSON-1290777604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6f2a7204-de11-43fa-9a50-9371ddeea6a2 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:25:16 devstack sudo[83193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6f2a7204-de11-43fa-9a50-9371ddeea6a2
Apr 02 10:25:16 devstack sudo[83193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:25:17 devstack sudo[83193]: pam_unix(sudo:session): session closed for user root
Apr 02 10:25:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d699043d-fcf7-425b-b0fe-3c54bcdb4f81 tempest-ServerRescueNegativeTestJSON-1290777604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6f2a7204-de11-43fa-9a50-9371ddeea6a2" returned: 0 in 1.443s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:25:17 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d699043d-fcf7-425b-b0fe-3c54bcdb4f81 tempest-ServerRescueNegativeTestJSON-1290777604 None] <== create_volume: return (2242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:25:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d699043d-fcf7-425b-b0fe-3c54bcdb4f81 tempest-ServerRescueNegativeTestJSON-1290777604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.245s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:25:17 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d699043d-fcf7-425b-b0fe-3c54bcdb4f81 tempest-ServerRescueNegativeTestJSON-1290777604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aaf4a2e-e8d8-4f98-b3fd-07fea971a028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f2a7204-de11-43fa-9a50-9371ddeea6a2', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:25:17 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d699043d-fcf7-425b-b0fe-3c54bcdb4f81 tempest-ServerRescueNegativeTestJSON-1290777604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2badbe9-eb48-429a-883f-9191116453f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:25:17 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-d699043d-fcf7-425b-b0fe-3c54bcdb4f81 tempest-ServerRescueNegativeTestJSON-1290777604 None] Volume volume-6f2a7204-de11-43fa-9a50-9371ddeea6a2 (6f2a7204-de11-43fa-9a50-9371ddeea6a2): created successfully
Apr 02 10:25:17 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d699043d-fcf7-425b-b0fe-3c54bcdb4f81 tempest-ServerRescueNegativeTestJSON-1290777604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2badbe9-eb48-429a-883f-9191116453f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:25:17 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d699043d-fcf7-425b-b0fe-3c54bcdb4f81 tempest-ServerRescueNegativeTestJSON-1290777604 None] Flow 'volume_create_manager' (5e4c9a53-0d28-4f62-92db-8ae6f2f581c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:25:17 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-d699043d-fcf7-425b-b0fe-3c54bcdb4f81 tempest-ServerRescueNegativeTestJSON-1290777604 None] Created volume successfully.
Apr 02 10:25:18 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-e90d6eea-6577-4977-b82d-aaa69235a9a2 tempest-VolumesTestJSON-1925290122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:25:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e90d6eea-6577-4977-b82d-aaa69235a9a2 tempest-VolumesTestJSON-1925290122 None] Flow 'volume_create_manager' (64543846-7d16-4749-a757-a359a62967bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:25:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e90d6eea-6577-4977-b82d-aaa69235a9a2 tempest-VolumesTestJSON-1925290122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4314282-09b1-4cb3-be4a-a44a3e021b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:25:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e90d6eea-6577-4977-b82d-aaa69235a9a2 tempest-VolumesTestJSON-1925290122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4314282-09b1-4cb3-be4a-a44a3e021b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-405180934',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f24fd5aa-8fee-41ba-8719-f69b5486595f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='44df9cb8bc854975b0c6629c668dd24f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:25:18Z,use_quota=True,user_id='8109898e2ba348ee99b4b1044134f8c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:25:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e90d6eea-6577-4977-b82d-aaa69235a9a2 tempest-VolumesTestJSON-1925290122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad59476b-5382-4597-ac6b-89daa03292c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:25:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e90d6eea-6577-4977-b82d-aaa69235a9a2 tempest-VolumesTestJSON-1925290122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad59476b-5382-4597-ac6b-89daa03292c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:25:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e90d6eea-6577-4977-b82d-aaa69235a9a2 tempest-VolumesTestJSON-1925290122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cf4af9e-5292-4fe8-a224-40baa68ef57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:25:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e90d6eea-6577-4977-b82d-aaa69235a9a2 tempest-VolumesTestJSON-1925290122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cf4af9e-5292-4fe8-a224-40baa68ef57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f24fd5aa-8fee-41ba-8719-f69b5486595f', 'volume_name': 'volume-f24fd5aa-8fee-41ba-8719-f69b5486595f', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:25:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e90d6eea-6577-4977-b82d-aaa69235a9a2 tempest-VolumesTestJSON-1925290122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f590832f-c438-4a15-8f0e-08a97f6d3a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:25:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e90d6eea-6577-4977-b82d-aaa69235a9a2 tempest-VolumesTestJSON-1925290122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f590832f-c438-4a15-8f0e-08a97f6d3a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:25:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e90d6eea-6577-4977-b82d-aaa69235a9a2 tempest-VolumesTestJSON-1925290122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95aa7af8-90e4-4d41-ac9a-dac014bd699e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:25:18 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-e90d6eea-6577-4977-b82d-aaa69235a9a2 tempest-VolumesTestJSON-1925290122 None] Volume f24fd5aa-8fee-41ba-8719-f69b5486595f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f24fd5aa-8fee-41ba-8719-f69b5486595f', 'volume_size': 1}
Apr 02 10:25:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e90d6eea-6577-4977-b82d-aaa69235a9a2 tempest-VolumesTestJSON-1925290122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:25:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e90d6eea-6577-4977-b82d-aaa69235a9a2 tempest-VolumesTestJSON-1925290122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:25:18 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e90d6eea-6577-4977-b82d-aaa69235a9a2 tempest-VolumesTestJSON-1925290122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-405180934',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f24fd5aa-8fee-41ba-8719-f69b5486595f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='44df9cb8bc854975b0c6629c668dd24f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:25:18Z,use_quota=True,user_id='8109898e2ba348ee99b4b1044134f8c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:25:18 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-e90d6eea-6577-4977-b82d-aaa69235a9a2 tempest-VolumesTestJSON-1925290122 None] Creating volume f24fd5aa-8fee-41ba-8719-f69b5486595f {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:25:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e90d6eea-6577-4977-b82d-aaa69235a9a2 tempest-VolumesTestJSON-1925290122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:25:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e90d6eea-6577-4977-b82d-aaa69235a9a2 tempest-VolumesTestJSON-1925290122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:25:18 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e90d6eea-6577-4977-b82d-aaa69235a9a2 tempest-VolumesTestJSON-1925290122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:25:18 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e90d6eea-6577-4977-b82d-aaa69235a9a2 tempest-VolumesTestJSON-1925290122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:25:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e90d6eea-6577-4977-b82d-aaa69235a9a2 tempest-VolumesTestJSON-1925290122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:25:18 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e90d6eea-6577-4977-b82d-aaa69235a9a2 tempest-VolumesTestJSON-1925290122 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:25:18 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-e90d6eea-6577-4977-b82d-aaa69235a9a2 tempest-VolumesTestJSON-1925290122 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:25:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e90d6eea-6577-4977-b82d-aaa69235a9a2 tempest-VolumesTestJSON-1925290122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f24fd5aa-8fee-41ba-8719-f69b5486595f 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:25:18 devstack sudo[83198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f24fd5aa-8fee-41ba-8719-f69b5486595f 1073741824
Apr 02 10:25:18 devstack sudo[83198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:25:19 devstack sudo[83198]: pam_unix(sudo:session): session closed for user root
Apr 02 10:25:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e90d6eea-6577-4977-b82d-aaa69235a9a2 tempest-VolumesTestJSON-1925290122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f24fd5aa-8fee-41ba-8719-f69b5486595f 1073741824" returned: 0 in 0.973s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:25:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e90d6eea-6577-4977-b82d-aaa69235a9a2 tempest-VolumesTestJSON-1925290122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f24fd5aa-8fee-41ba-8719-f69b5486595f {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:25:19 devstack sudo[83208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f24fd5aa-8fee-41ba-8719-f69b5486595f
Apr 02 10:25:19 devstack sudo[83208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:25:20 devstack sudo[83208]: pam_unix(sudo:session): session closed for user root
Apr 02 10:25:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e90d6eea-6577-4977-b82d-aaa69235a9a2 tempest-VolumesTestJSON-1925290122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f24fd5aa-8fee-41ba-8719-f69b5486595f" returned: 0 in 1.023s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:25:20 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e90d6eea-6577-4977-b82d-aaa69235a9a2 tempest-VolumesTestJSON-1925290122 None] <== create_volume: return (2035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:25:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e90d6eea-6577-4977-b82d-aaa69235a9a2 tempest-VolumesTestJSON-1925290122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.037s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:25:20 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e90d6eea-6577-4977-b82d-aaa69235a9a2 tempest-VolumesTestJSON-1925290122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95aa7af8-90e4-4d41-ac9a-dac014bd699e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f24fd5aa-8fee-41ba-8719-f69b5486595f', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:25:20 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e90d6eea-6577-4977-b82d-aaa69235a9a2 tempest-VolumesTestJSON-1925290122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aa961dd-2a47-4090-890f-1bc7e89c3a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:25:20 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-e90d6eea-6577-4977-b82d-aaa69235a9a2 tempest-VolumesTestJSON-1925290122 None] Volume volume-f24fd5aa-8fee-41ba-8719-f69b5486595f (f24fd5aa-8fee-41ba-8719-f69b5486595f): created successfully
Apr 02 10:25:20 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e90d6eea-6577-4977-b82d-aaa69235a9a2 tempest-VolumesTestJSON-1925290122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aa961dd-2a47-4090-890f-1bc7e89c3a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:25:20 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e90d6eea-6577-4977-b82d-aaa69235a9a2 tempest-VolumesTestJSON-1925290122 None] Flow 'volume_create_manager' (64543846-7d16-4749-a757-a359a62967bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:25:20 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-e90d6eea-6577-4977-b82d-aaa69235a9a2 tempest-VolumesTestJSON-1925290122 None] Created volume successfully.
Apr 02 10:25:22 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9f53ee6-bd29-4ee0-9d59-dad813141aef tempest-VolumesTestJSON-1925290122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:25:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c9f53ee6-bd29-4ee0-9d59-dad813141aef tempest-VolumesTestJSON-1925290122 None] Flow 'volume_create_manager' (caf76dd0-e524-4c69-9b58-4140429c5324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:25:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c9f53ee6-bd29-4ee0-9d59-dad813141aef tempest-VolumesTestJSON-1925290122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afe507cc-be83-474d-8dc1-d1c4a257a898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:25:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c9f53ee6-bd29-4ee0-9d59-dad813141aef tempest-VolumesTestJSON-1925290122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afe507cc-be83-474d-8dc1-d1c4a257a898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1899520040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=834d598c-984b-4531-8eb7-5bd35f4ff738,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='44df9cb8bc854975b0c6629c668dd24f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:25:22Z,use_quota=True,user_id='8109898e2ba348ee99b4b1044134f8c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:25:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c9f53ee6-bd29-4ee0-9d59-dad813141aef tempest-VolumesTestJSON-1925290122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbe913f3-89c6-48bc-8e94-cdd8a3ee7e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:25:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c9f53ee6-bd29-4ee0-9d59-dad813141aef tempest-VolumesTestJSON-1925290122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbe913f3-89c6-48bc-8e94-cdd8a3ee7e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:25:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c9f53ee6-bd29-4ee0-9d59-dad813141aef tempest-VolumesTestJSON-1925290122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ca20b8-3169-4954-8338-f475f0ac2fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:25:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c9f53ee6-bd29-4ee0-9d59-dad813141aef tempest-VolumesTestJSON-1925290122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ca20b8-3169-4954-8338-f475f0ac2fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '834d598c-984b-4531-8eb7-5bd35f4ff738', 'volume_name': 'volume-834d598c-984b-4531-8eb7-5bd35f4ff738', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:25:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c9f53ee6-bd29-4ee0-9d59-dad813141aef tempest-VolumesTestJSON-1925290122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b6c945-0a58-45dd-9c47-ebe3c449a6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:25:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c9f53ee6-bd29-4ee0-9d59-dad813141aef tempest-VolumesTestJSON-1925290122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b6c945-0a58-45dd-9c47-ebe3c449a6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:25:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c9f53ee6-bd29-4ee0-9d59-dad813141aef tempest-VolumesTestJSON-1925290122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38aa7171-a4c5-4707-b59a-c037db673530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:25:22 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-c9f53ee6-bd29-4ee0-9d59-dad813141aef tempest-VolumesTestJSON-1925290122 None] Volume 834d598c-984b-4531-8eb7-5bd35f4ff738: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-834d598c-984b-4531-8eb7-5bd35f4ff738', 'volume_size': 1}
Apr 02 10:25:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-c9f53ee6-bd29-4ee0-9d59-dad813141aef tempest-VolumesTestJSON-1925290122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:25:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-c9f53ee6-bd29-4ee0-9d59-dad813141aef tempest-VolumesTestJSON-1925290122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:25:22 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-c9f53ee6-bd29-4ee0-9d59-dad813141aef tempest-VolumesTestJSON-1925290122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1899520040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=834d598c-984b-4531-8eb7-5bd35f4ff738,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='44df9cb8bc854975b0c6629c668dd24f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:25:22Z,use_quota=True,user_id='8109898e2ba348ee99b4b1044134f8c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:25:22 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-c9f53ee6-bd29-4ee0-9d59-dad813141aef tempest-VolumesTestJSON-1925290122 None] Creating volume 834d598c-984b-4531-8eb7-5bd35f4ff738 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:25:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-c9f53ee6-bd29-4ee0-9d59-dad813141aef tempest-VolumesTestJSON-1925290122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:25:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-c9f53ee6-bd29-4ee0-9d59-dad813141aef tempest-VolumesTestJSON-1925290122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:25:22 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-c9f53ee6-bd29-4ee0-9d59-dad813141aef tempest-VolumesTestJSON-1925290122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:25:22 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-c9f53ee6-bd29-4ee0-9d59-dad813141aef tempest-VolumesTestJSON-1925290122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:25:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-c9f53ee6-bd29-4ee0-9d59-dad813141aef tempest-VolumesTestJSON-1925290122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:25:22 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-c9f53ee6-bd29-4ee0-9d59-dad813141aef tempest-VolumesTestJSON-1925290122 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:25:22 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-c9f53ee6-bd29-4ee0-9d59-dad813141aef tempest-VolumesTestJSON-1925290122 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:25:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c9f53ee6-bd29-4ee0-9d59-dad813141aef tempest-VolumesTestJSON-1925290122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-834d598c-984b-4531-8eb7-5bd35f4ff738 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:25:22 devstack sudo[83214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-834d598c-984b-4531-8eb7-5bd35f4ff738 1073741824
Apr 02 10:25:22 devstack sudo[83214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:25:23 devstack sudo[83214]: pam_unix(sudo:session): session closed for user root
Apr 02 10:25:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c9f53ee6-bd29-4ee0-9d59-dad813141aef tempest-VolumesTestJSON-1925290122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-834d598c-984b-4531-8eb7-5bd35f4ff738 1073741824" returned: 0 in 0.626s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:25:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c9f53ee6-bd29-4ee0-9d59-dad813141aef tempest-VolumesTestJSON-1925290122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-834d598c-984b-4531-8eb7-5bd35f4ff738 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:25:23 devstack sudo[83237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-834d598c-984b-4531-8eb7-5bd35f4ff738
Apr 02 10:25:23 devstack sudo[83237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:25:23 devstack sudo[83237]: pam_unix(sudo:session): session closed for user root
Apr 02 10:25:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c9f53ee6-bd29-4ee0-9d59-dad813141aef tempest-VolumesTestJSON-1925290122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-834d598c-984b-4531-8eb7-5bd35f4ff738" returned: 0 in 0.558s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:25:23 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-c9f53ee6-bd29-4ee0-9d59-dad813141aef tempest-VolumesTestJSON-1925290122 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:25:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-c9f53ee6-bd29-4ee0-9d59-dad813141aef tempest-VolumesTestJSON-1925290122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:25:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c9f53ee6-bd29-4ee0-9d59-dad813141aef tempest-VolumesTestJSON-1925290122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38aa7171-a4c5-4707-b59a-c037db673530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-834d598c-984b-4531-8eb7-5bd35f4ff738', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:25:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c9f53ee6-bd29-4ee0-9d59-dad813141aef tempest-VolumesTestJSON-1925290122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (151aef37-f819-4af1-9d9f-1772750e00a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:25:23 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-c9f53ee6-bd29-4ee0-9d59-dad813141aef tempest-VolumesTestJSON-1925290122 None] Volume volume-834d598c-984b-4531-8eb7-5bd35f4ff738 (834d598c-984b-4531-8eb7-5bd35f4ff738): created successfully
Apr 02 10:25:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c9f53ee6-bd29-4ee0-9d59-dad813141aef tempest-VolumesTestJSON-1925290122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (151aef37-f819-4af1-9d9f-1772750e00a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:25:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c9f53ee6-bd29-4ee0-9d59-dad813141aef tempest-VolumesTestJSON-1925290122 None] Flow 'volume_create_manager' (caf76dd0-e524-4c69-9b58-4140429c5324) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:25:23 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-c9f53ee6-bd29-4ee0-9d59-dad813141aef tempest-VolumesTestJSON-1925290122 None] Created volume successfully.
Apr 02 10:25:25 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6179636-b4d5-4844-9826-36cdc36015e7 tempest-VolumesTestJSON-1925290122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:25:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e6179636-b4d5-4844-9826-36cdc36015e7 tempest-VolumesTestJSON-1925290122 None] Flow 'volume_create_manager' (8e71051d-d648-4ab9-aef5-e02465fe4628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:25:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e6179636-b4d5-4844-9826-36cdc36015e7 tempest-VolumesTestJSON-1925290122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (748f4f17-d50d-4d5e-a555-02a0421bbe7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:25:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e6179636-b4d5-4844-9826-36cdc36015e7 tempest-VolumesTestJSON-1925290122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (748f4f17-d50d-4d5e-a555-02a0421bbe7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-537399338',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db418fe-9ddb-4551-bbe2-2248b3cda290,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='44df9cb8bc854975b0c6629c668dd24f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:25:25Z,use_quota=True,user_id='8109898e2ba348ee99b4b1044134f8c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:25:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e6179636-b4d5-4844-9826-36cdc36015e7 tempest-VolumesTestJSON-1925290122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5cafe8a-89d5-4d36-a4ed-86d916130811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:25:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e6179636-b4d5-4844-9826-36cdc36015e7 tempest-VolumesTestJSON-1925290122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5cafe8a-89d5-4d36-a4ed-86d916130811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:25:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e6179636-b4d5-4844-9826-36cdc36015e7 tempest-VolumesTestJSON-1925290122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19e92d9e-9004-4da6-bf7c-2b49a82065e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:25:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e6179636-b4d5-4844-9826-36cdc36015e7 tempest-VolumesTestJSON-1925290122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19e92d9e-9004-4da6-bf7c-2b49a82065e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5db418fe-9ddb-4551-bbe2-2248b3cda290', 'volume_name': 'volume-5db418fe-9ddb-4551-bbe2-2248b3cda290', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:25:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e6179636-b4d5-4844-9826-36cdc36015e7 tempest-VolumesTestJSON-1925290122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b957c97-9e84-40ff-8966-9a8d3d78915a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:25:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e6179636-b4d5-4844-9826-36cdc36015e7 tempest-VolumesTestJSON-1925290122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b957c97-9e84-40ff-8966-9a8d3d78915a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:25:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e6179636-b4d5-4844-9826-36cdc36015e7 tempest-VolumesTestJSON-1925290122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5b5369e-da03-4382-bd4c-06af2db99327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:25:25 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-e6179636-b4d5-4844-9826-36cdc36015e7 tempest-VolumesTestJSON-1925290122 None] Volume 5db418fe-9ddb-4551-bbe2-2248b3cda290: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5db418fe-9ddb-4551-bbe2-2248b3cda290', 'volume_size': 1}
Apr 02 10:25:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e6179636-b4d5-4844-9826-36cdc36015e7 tempest-VolumesTestJSON-1925290122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:25:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e6179636-b4d5-4844-9826-36cdc36015e7 tempest-VolumesTestJSON-1925290122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:25:25 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e6179636-b4d5-4844-9826-36cdc36015e7 tempest-VolumesTestJSON-1925290122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-537399338',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db418fe-9ddb-4551-bbe2-2248b3cda290,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='44df9cb8bc854975b0c6629c668dd24f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:25:25Z,use_quota=True,user_id='8109898e2ba348ee99b4b1044134f8c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:25:25 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-e6179636-b4d5-4844-9826-36cdc36015e7 tempest-VolumesTestJSON-1925290122 None] Creating volume 5db418fe-9ddb-4551-bbe2-2248b3cda290 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:25:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e6179636-b4d5-4844-9826-36cdc36015e7 tempest-VolumesTestJSON-1925290122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:25:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e6179636-b4d5-4844-9826-36cdc36015e7 tempest-VolumesTestJSON-1925290122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:25:25 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e6179636-b4d5-4844-9826-36cdc36015e7 tempest-VolumesTestJSON-1925290122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:25:25 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e6179636-b4d5-4844-9826-36cdc36015e7 tempest-VolumesTestJSON-1925290122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:25:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e6179636-b4d5-4844-9826-36cdc36015e7 tempest-VolumesTestJSON-1925290122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:25:25 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e6179636-b4d5-4844-9826-36cdc36015e7 tempest-VolumesTestJSON-1925290122 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:25:25 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-e6179636-b4d5-4844-9826-36cdc36015e7 tempest-VolumesTestJSON-1925290122 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:25:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e6179636-b4d5-4844-9826-36cdc36015e7 tempest-VolumesTestJSON-1925290122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-5db418fe-9ddb-4551-bbe2-2248b3cda290 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:25:25 devstack sudo[83251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-5db418fe-9ddb-4551-bbe2-2248b3cda290 1073741824
Apr 02 10:25:25 devstack sudo[83251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:25:26 devstack sudo[83251]: pam_unix(sudo:session): session closed for user root
Apr 02 10:25:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e6179636-b4d5-4844-9826-36cdc36015e7 tempest-VolumesTestJSON-1925290122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-5db418fe-9ddb-4551-bbe2-2248b3cda290 1073741824" returned: 0 in 0.782s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:25:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e6179636-b4d5-4844-9826-36cdc36015e7 tempest-VolumesTestJSON-1925290122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-5db418fe-9ddb-4551-bbe2-2248b3cda290 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:25:26 devstack sudo[83257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-5db418fe-9ddb-4551-bbe2-2248b3cda290
Apr 02 10:25:26 devstack sudo[83257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:25:26 devstack sudo[83257]: pam_unix(sudo:session): session closed for user root
Apr 02 10:25:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e6179636-b4d5-4844-9826-36cdc36015e7 tempest-VolumesTestJSON-1925290122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-5db418fe-9ddb-4551-bbe2-2248b3cda290" returned: 0 in 0.510s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:25:26 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e6179636-b4d5-4844-9826-36cdc36015e7 tempest-VolumesTestJSON-1925290122 None] <== create_volume: return (1365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:25:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e6179636-b4d5-4844-9826-36cdc36015e7 tempest-VolumesTestJSON-1925290122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:25:26 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e6179636-b4d5-4844-9826-36cdc36015e7 tempest-VolumesTestJSON-1925290122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5b5369e-da03-4382-bd4c-06af2db99327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5db418fe-9ddb-4551-bbe2-2248b3cda290', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:25:26 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e6179636-b4d5-4844-9826-36cdc36015e7 tempest-VolumesTestJSON-1925290122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3855096-c626-47de-83fd-55d011590df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:25:26 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-e6179636-b4d5-4844-9826-36cdc36015e7 tempest-VolumesTestJSON-1925290122 None] Volume volume-5db418fe-9ddb-4551-bbe2-2248b3cda290 (5db418fe-9ddb-4551-bbe2-2248b3cda290): created successfully
Apr 02 10:25:26 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e6179636-b4d5-4844-9826-36cdc36015e7 tempest-VolumesTestJSON-1925290122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3855096-c626-47de-83fd-55d011590df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:25:26 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e6179636-b4d5-4844-9826-36cdc36015e7 tempest-VolumesTestJSON-1925290122 None] Flow 'volume_create_manager' (8e71051d-d648-4ab9-aef5-e02465fe4628) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:25:26 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-e6179636-b4d5-4844-9826-36cdc36015e7 tempest-VolumesTestJSON-1925290122 None] Created volume successfully.
Apr 02 10:25:28 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5cc40eec-c24a-4cbc-bdfb-cd16e74a726b tempest-VolumesTestJSON-1925290122 None] Acquiring lock "cinder-5db418fe-9ddb-4551-bbe2-2248b3cda290-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:25:28 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5cc40eec-c24a-4cbc-bdfb-cd16e74a726b tempest-VolumesTestJSON-1925290122 None] Lock "cinder-5db418fe-9ddb-4551-bbe2-2248b3cda290-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:25:28 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5cc40eec-c24a-4cbc-bdfb-cd16e74a726b tempest-VolumesTestJSON-1925290122 None] Acquiring lock "cinder-quobyte-5db418fe-9ddb-4551-bbe2-2248b3cda290" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:25:28 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5cc40eec-c24a-4cbc-bdfb-cd16e74a726b tempest-VolumesTestJSON-1925290122 None] Lock "cinder-quobyte-5db418fe-9ddb-4551-bbe2-2248b3cda290" acquired by "delete_volume" :: waited 0.016s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:25:28 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e08fca-0c30-4318-a64a-63f223e2d7df]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:25:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5cc40eec-c24a-4cbc-bdfb-cd16e74a726b tempest-VolumesTestJSON-1925290122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-5db418fe-9ddb-4551-bbe2-2248b3cda290 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:25:28 devstack sudo[83292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-5db418fe-9ddb-4551-bbe2-2248b3cda290
Apr 02 10:25:28 devstack sudo[83292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:25:29 devstack sudo[83292]: pam_unix(sudo:session): session closed for user root
Apr 02 10:25:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5cc40eec-c24a-4cbc-bdfb-cd16e74a726b tempest-VolumesTestJSON-1925290122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-5db418fe-9ddb-4551-bbe2-2248b3cda290" returned: 0 in 0.901s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:25:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5cc40eec-c24a-4cbc-bdfb-cd16e74a726b tempest-VolumesTestJSON-1925290122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-5db418fe-9ddb-4551-bbe2-2248b3cda290 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:25:29 devstack sudo[83299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-5db418fe-9ddb-4551-bbe2-2248b3cda290
Apr 02 10:25:29 devstack sudo[83299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:25:30 devstack sudo[83299]: pam_unix(sudo:session): session closed for user root
Apr 02 10:25:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5cc40eec-c24a-4cbc-bdfb-cd16e74a726b tempest-VolumesTestJSON-1925290122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-5db418fe-9ddb-4551-bbe2-2248b3cda290" returned: 0 in 1.140s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:25:30 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5cc40eec-c24a-4cbc-bdfb-cd16e74a726b tempest-VolumesTestJSON-1925290122 None] Lock "cinder-quobyte-5db418fe-9ddb-4551-bbe2-2248b3cda290" released by "delete_volume" :: held 2.118s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:25:30 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-5cc40eec-c24a-4cbc-bdfb-cd16e74a726b tempest-VolumesTestJSON-1925290122 None] Created reservations ['1f10448b-d46a-4b5d-bc23-bd39551862ea', '30a3eb63-0830-4adc-b0db-94639b37140c', '314525ea-79f3-424f-a9fb-c68d4c32974b', '0b6ecd8b-fe98-4e42-9f3e-4a13f093ca81'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:25:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5cc40eec-c24a-4cbc-bdfb-cd16e74a726b tempest-VolumesTestJSON-1925290122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:25:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5cc40eec-c24a-4cbc-bdfb-cd16e74a726b tempest-VolumesTestJSON-1925290122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:25:30 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5cc40eec-c24a-4cbc-bdfb-cd16e74a726b tempest-VolumesTestJSON-1925290122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:25:30 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5cc40eec-c24a-4cbc-bdfb-cd16e74a726b tempest-VolumesTestJSON-1925290122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:25:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5cc40eec-c24a-4cbc-bdfb-cd16e74a726b tempest-VolumesTestJSON-1925290122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:25:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5cc40eec-c24a-4cbc-bdfb-cd16e74a726b tempest-VolumesTestJSON-1925290122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:25:30 devstack sudo[83305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:25:30 devstack sudo[83305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:25:31 devstack sudo[83305]: pam_unix(sudo:session): session closed for user root
Apr 02 10:25:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5cc40eec-c24a-4cbc-bdfb-cd16e74a726b tempest-VolumesTestJSON-1925290122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.980s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:25:31 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-5cc40eec-c24a-4cbc-bdfb-cd16e74a726b tempest-VolumesTestJSON-1925290122 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:25:31 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9e5dc69d-c3d3-446a-b3e8-95abf5ba9aad tempest-VolumesTestJSON-1925290122 None] Acquiring lock "cinder-834d598c-984b-4531-8eb7-5bd35f4ff738-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:25:31 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-5cc40eec-c24a-4cbc-bdfb-cd16e74a726b tempest-VolumesTestJSON-1925290122 None] Deleted volume successfully.
Apr 02 10:25:31 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9e5dc69d-c3d3-446a-b3e8-95abf5ba9aad tempest-VolumesTestJSON-1925290122 None] Lock "cinder-834d598c-984b-4531-8eb7-5bd35f4ff738-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:25:31 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5cc40eec-c24a-4cbc-bdfb-cd16e74a726b tempest-VolumesTestJSON-1925290122 None] Lock "cinder-5db418fe-9ddb-4551-bbe2-2248b3cda290-delete_volume" released by "delete_volume" :: held 3.481s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:25:31 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9e5dc69d-c3d3-446a-b3e8-95abf5ba9aad tempest-VolumesTestJSON-1925290122 None] Acquiring lock "cinder-quobyte-834d598c-984b-4531-8eb7-5bd35f4ff738" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:25:31 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9e5dc69d-c3d3-446a-b3e8-95abf5ba9aad tempest-VolumesTestJSON-1925290122 None] Lock "cinder-quobyte-834d598c-984b-4531-8eb7-5bd35f4ff738" acquired by "delete_volume" :: waited 0.024s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:25:31 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fac84fc-691e-44fa-9084-26ec5a592df9]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:25:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9e5dc69d-c3d3-446a-b3e8-95abf5ba9aad tempest-VolumesTestJSON-1925290122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-834d598c-984b-4531-8eb7-5bd35f4ff738 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:25:32 devstack sudo[83312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-834d598c-984b-4531-8eb7-5bd35f4ff738
Apr 02 10:25:32 devstack sudo[83312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:25:33 devstack sudo[83312]: pam_unix(sudo:session): session closed for user root
Apr 02 10:25:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9e5dc69d-c3d3-446a-b3e8-95abf5ba9aad tempest-VolumesTestJSON-1925290122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-834d598c-984b-4531-8eb7-5bd35f4ff738" returned: 0 in 1.241s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:25:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9e5dc69d-c3d3-446a-b3e8-95abf5ba9aad tempest-VolumesTestJSON-1925290122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-834d598c-984b-4531-8eb7-5bd35f4ff738 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:25:33 devstack sudo[83322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-834d598c-984b-4531-8eb7-5bd35f4ff738
Apr 02 10:25:33 devstack sudo[83322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:25:34 devstack sudo[83322]: pam_unix(sudo:session): session closed for user root
Apr 02 10:25:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9e5dc69d-c3d3-446a-b3e8-95abf5ba9aad tempest-VolumesTestJSON-1925290122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-834d598c-984b-4531-8eb7-5bd35f4ff738" returned: 0 in 1.197s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:25:34 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9e5dc69d-c3d3-446a-b3e8-95abf5ba9aad tempest-VolumesTestJSON-1925290122 None] Lock "cinder-quobyte-834d598c-984b-4531-8eb7-5bd35f4ff738" released by "delete_volume" :: held 2.490s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:25:34 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-9e5dc69d-c3d3-446a-b3e8-95abf5ba9aad tempest-VolumesTestJSON-1925290122 None] Created reservations ['7c3e5070-c696-4c61-a501-4a174d0d25a5', 'a57a04de-4d1f-49ac-90d0-ebbbc6bdff0c', '76ecc31f-9018-4d6f-8c3f-d294dbb2bc6a', '717c6771-7eba-4edf-9329-08a2ca3114f2'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:25:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-9e5dc69d-c3d3-446a-b3e8-95abf5ba9aad tempest-VolumesTestJSON-1925290122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:25:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-9e5dc69d-c3d3-446a-b3e8-95abf5ba9aad tempest-VolumesTestJSON-1925290122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:25:34 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-9e5dc69d-c3d3-446a-b3e8-95abf5ba9aad tempest-VolumesTestJSON-1925290122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:25:34 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-9e5dc69d-c3d3-446a-b3e8-95abf5ba9aad tempest-VolumesTestJSON-1925290122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:25:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-9e5dc69d-c3d3-446a-b3e8-95abf5ba9aad tempest-VolumesTestJSON-1925290122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:25:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9e5dc69d-c3d3-446a-b3e8-95abf5ba9aad tempest-VolumesTestJSON-1925290122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:25:34 devstack sudo[83338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:25:34 devstack sudo[83338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:25:35 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-911a297a-34ea-4f1c-848d-1bb97a3a3e9a tempest-VolumesTestJSON-1925290122 None] Acquiring lock "cinder-f24fd5aa-8fee-41ba-8719-f69b5486595f-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:25:35 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-911a297a-34ea-4f1c-848d-1bb97a3a3e9a tempest-VolumesTestJSON-1925290122 None] Lock "cinder-f24fd5aa-8fee-41ba-8719-f69b5486595f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:25:35 devstack sudo[83338]: pam_unix(sudo:session): session closed for user root
Apr 02 10:25:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9e5dc69d-c3d3-446a-b3e8-95abf5ba9aad tempest-VolumesTestJSON-1925290122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.747s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:25:35 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-9e5dc69d-c3d3-446a-b3e8-95abf5ba9aad tempest-VolumesTestJSON-1925290122 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:25:35 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-911a297a-34ea-4f1c-848d-1bb97a3a3e9a tempest-VolumesTestJSON-1925290122 None] Acquiring lock "cinder-quobyte-f24fd5aa-8fee-41ba-8719-f69b5486595f" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:25:35 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-9e5dc69d-c3d3-446a-b3e8-95abf5ba9aad tempest-VolumesTestJSON-1925290122 None] Deleted volume successfully.
Apr 02 10:25:35 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9e5dc69d-c3d3-446a-b3e8-95abf5ba9aad tempest-VolumesTestJSON-1925290122 None] Lock "cinder-834d598c-984b-4531-8eb7-5bd35f4ff738-delete_volume" released by "delete_volume" :: held 3.467s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:25:35 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-911a297a-34ea-4f1c-848d-1bb97a3a3e9a tempest-VolumesTestJSON-1925290122 None] Lock "cinder-quobyte-f24fd5aa-8fee-41ba-8719-f69b5486595f" acquired by "delete_volume" :: waited 0.030s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:25:35 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb2e4e6-cff3-4ef0-9fd1-50b44e35b7e1]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:25:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-911a297a-34ea-4f1c-848d-1bb97a3a3e9a tempest-VolumesTestJSON-1925290122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f24fd5aa-8fee-41ba-8719-f69b5486595f {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:25:35 devstack sudo[83341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f24fd5aa-8fee-41ba-8719-f69b5486595f
Apr 02 10:25:35 devstack sudo[83341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:25:36 devstack sudo[83341]: pam_unix(sudo:session): session closed for user root
Apr 02 10:25:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-911a297a-34ea-4f1c-848d-1bb97a3a3e9a tempest-VolumesTestJSON-1925290122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f24fd5aa-8fee-41ba-8719-f69b5486595f" returned: 0 in 0.787s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:25:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-911a297a-34ea-4f1c-848d-1bb97a3a3e9a tempest-VolumesTestJSON-1925290122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f24fd5aa-8fee-41ba-8719-f69b5486595f {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:25:36 devstack sudo[83347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f24fd5aa-8fee-41ba-8719-f69b5486595f
Apr 02 10:25:36 devstack sudo[83347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:25:36 devstack sudo[83347]: pam_unix(sudo:session): session closed for user root
Apr 02 10:25:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-911a297a-34ea-4f1c-848d-1bb97a3a3e9a tempest-VolumesTestJSON-1925290122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f24fd5aa-8fee-41ba-8719-f69b5486595f" returned: 0 in 0.692s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:25:36 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-911a297a-34ea-4f1c-848d-1bb97a3a3e9a tempest-VolumesTestJSON-1925290122 None] Lock "cinder-quobyte-f24fd5aa-8fee-41ba-8719-f69b5486595f" released by "delete_volume" :: held 1.508s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:25:36 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-911a297a-34ea-4f1c-848d-1bb97a3a3e9a tempest-VolumesTestJSON-1925290122 None] Created reservations ['760ebbd5-989f-46d4-b280-478fdfbd8400', 'fc45fded-6017-4b52-bd71-220ea24fc95c', '28b42729-5998-429a-abd5-4d6b37b8e8cc', '5ed00f11-2c0f-4b48-a491-439f961532b6'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:25:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-911a297a-34ea-4f1c-848d-1bb97a3a3e9a tempest-VolumesTestJSON-1925290122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:25:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-911a297a-34ea-4f1c-848d-1bb97a3a3e9a tempest-VolumesTestJSON-1925290122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:25:36 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-911a297a-34ea-4f1c-848d-1bb97a3a3e9a tempest-VolumesTestJSON-1925290122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:25:36 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-911a297a-34ea-4f1c-848d-1bb97a3a3e9a tempest-VolumesTestJSON-1925290122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:25:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-911a297a-34ea-4f1c-848d-1bb97a3a3e9a tempest-VolumesTestJSON-1925290122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:25:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-911a297a-34ea-4f1c-848d-1bb97a3a3e9a tempest-VolumesTestJSON-1925290122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:25:36 devstack sudo[83390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:25:36 devstack sudo[83390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:25:37 devstack sudo[83390]: pam_unix(sudo:session): session closed for user root
Apr 02 10:25:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-911a297a-34ea-4f1c-848d-1bb97a3a3e9a tempest-VolumesTestJSON-1925290122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 1.008s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:25:37 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-911a297a-34ea-4f1c-848d-1bb97a3a3e9a tempest-VolumesTestJSON-1925290122 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:25:37 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-911a297a-34ea-4f1c-848d-1bb97a3a3e9a tempest-VolumesTestJSON-1925290122 None] Deleted volume successfully.
Apr 02 10:25:37 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-911a297a-34ea-4f1c-848d-1bb97a3a3e9a tempest-VolumesTestJSON-1925290122 None] Lock "cinder-f24fd5aa-8fee-41ba-8719-f69b5486595f-delete_volume" released by "delete_volume" :: held 2.791s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:25:39 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-503b169d-77d8-4fa1-a28e-f71f0806aae7 tempest-ServerRescueNegativeTestJSON-1290777604 None] Acquiring lock "cinder-6f2a7204-de11-43fa-9a50-9371ddeea6a2-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:25:39 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-503b169d-77d8-4fa1-a28e-f71f0806aae7 tempest-ServerRescueNegativeTestJSON-1290777604 None] Lock "cinder-6f2a7204-de11-43fa-9a50-9371ddeea6a2-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:25:39 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-503b169d-77d8-4fa1-a28e-f71f0806aae7 tempest-ServerRescueNegativeTestJSON-1290777604 None] Acquiring lock "cinder-quobyte-6f2a7204-de11-43fa-9a50-9371ddeea6a2" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:25:39 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-503b169d-77d8-4fa1-a28e-f71f0806aae7 tempest-ServerRescueNegativeTestJSON-1290777604 None] Lock "cinder-quobyte-6f2a7204-de11-43fa-9a50-9371ddeea6a2" acquired by "delete_volume" :: waited 0.033s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:25:39 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3720a9e9-66ba-45dc-b2e5-3720657af064]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:25:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-503b169d-77d8-4fa1-a28e-f71f0806aae7 tempest-ServerRescueNegativeTestJSON-1290777604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6f2a7204-de11-43fa-9a50-9371ddeea6a2 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:25:39 devstack sudo[83435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6f2a7204-de11-43fa-9a50-9371ddeea6a2
Apr 02 10:25:39 devstack sudo[83435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:25:41 devstack sudo[83435]: pam_unix(sudo:session): session closed for user root
Apr 02 10:25:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-503b169d-77d8-4fa1-a28e-f71f0806aae7 tempest-ServerRescueNegativeTestJSON-1290777604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6f2a7204-de11-43fa-9a50-9371ddeea6a2" returned: 0 in 1.598s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:25:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-503b169d-77d8-4fa1-a28e-f71f0806aae7 tempest-ServerRescueNegativeTestJSON-1290777604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6f2a7204-de11-43fa-9a50-9371ddeea6a2 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:25:41 devstack sudo[83449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6f2a7204-de11-43fa-9a50-9371ddeea6a2
Apr 02 10:25:41 devstack sudo[83449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:25:42 devstack sudo[83449]: pam_unix(sudo:session): session closed for user root
Apr 02 10:25:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-503b169d-77d8-4fa1-a28e-f71f0806aae7 tempest-ServerRescueNegativeTestJSON-1290777604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6f2a7204-de11-43fa-9a50-9371ddeea6a2" returned: 0 in 0.751s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:25:42 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-503b169d-77d8-4fa1-a28e-f71f0806aae7 tempest-ServerRescueNegativeTestJSON-1290777604 None] Lock "cinder-quobyte-6f2a7204-de11-43fa-9a50-9371ddeea6a2" released by "delete_volume" :: held 2.396s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:25:42 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-503b169d-77d8-4fa1-a28e-f71f0806aae7 tempest-ServerRescueNegativeTestJSON-1290777604 None] Created reservations ['b2bad010-bdbd-49c1-a60e-279f23bea877', 'cb134550-79b5-4885-aa2b-7cc11e97f479', '19a43ebc-9dee-4e3a-93e3-b8961ea617a4', 'cbc3e006-ab51-44db-8dc3-befd2c4db36a'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:25:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-503b169d-77d8-4fa1-a28e-f71f0806aae7 tempest-ServerRescueNegativeTestJSON-1290777604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:25:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-503b169d-77d8-4fa1-a28e-f71f0806aae7 tempest-ServerRescueNegativeTestJSON-1290777604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:25:42 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-503b169d-77d8-4fa1-a28e-f71f0806aae7 tempest-ServerRescueNegativeTestJSON-1290777604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:25:42 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-503b169d-77d8-4fa1-a28e-f71f0806aae7 tempest-ServerRescueNegativeTestJSON-1290777604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:25:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-503b169d-77d8-4fa1-a28e-f71f0806aae7 tempest-ServerRescueNegativeTestJSON-1290777604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:25:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-503b169d-77d8-4fa1-a28e-f71f0806aae7 tempest-ServerRescueNegativeTestJSON-1290777604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:25:42 devstack sudo[83464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:25:42 devstack sudo[83464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:25:43 devstack sudo[83464]: pam_unix(sudo:session): session closed for user root
Apr 02 10:25:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-503b169d-77d8-4fa1-a28e-f71f0806aae7 tempest-ServerRescueNegativeTestJSON-1290777604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 1.112s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:25:43 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-503b169d-77d8-4fa1-a28e-f71f0806aae7 tempest-ServerRescueNegativeTestJSON-1290777604 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:25:43 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-503b169d-77d8-4fa1-a28e-f71f0806aae7 tempest-ServerRescueNegativeTestJSON-1290777604 None] Deleted volume successfully.
Apr 02 10:25:43 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-503b169d-77d8-4fa1-a28e-f71f0806aae7 tempest-ServerRescueNegativeTestJSON-1290777604 None] Lock "cinder-6f2a7204-de11-43fa-9a50-9371ddeea6a2-delete_volume" released by "delete_volume" :: held 3.916s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:25:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b5ae3535-e555-44fd-8fbd-016aaccff882 tempest-BackendsCapabilitiesAdminTestsJSON-146388733 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757984161377, 'free_capacity_gb': 1775.757984161377, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82102) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 02 10:25:49 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-1f8b1229-49b7-4f66-b1fa-edc877f22857 tempest-BackendsCapabilitiesAdminTestsJSON-146388733 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757984161377, 'free_capacity_gb': 1775.757984161377, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82102) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 02 10:25:52 devstack cinder-volume[82102]: DEBUG dbcounter [-] [82102] Writing DB stats cinder:SELECT=34,cinder:UPDATE=59,cinder:INSERT=13,cinder:DELETE=7 {{(pid=82102) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 02 10:25:53 devstack cinder-volume[82102]: DEBUG dbcounter [-] [82102] Writing DB stats cinder:SELECT=50,cinder:UPDATE=73,cinder:INSERT=17,cinder:DELETE=5 {{(pid=82102) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 02 10:26:01 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-6690ec34-fb80-476d-a12a-2aec2757c48d tempest-VolumeQuotasAdminTestJSON-111361220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:26:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-6690ec34-fb80-476d-a12a-2aec2757c48d tempest-VolumeQuotasAdminTestJSON-111361220 None] Flow 'volume_create_manager' (a467c1d4-b57f-429c-a5a2-18ec37edb2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:26:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-6690ec34-fb80-476d-a12a-2aec2757c48d tempest-VolumeQuotasAdminTestJSON-111361220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd95f195-1e3c-469d-8dab-e5afb4f36380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-6690ec34-fb80-476d-a12a-2aec2757c48d tempest-VolumeQuotasAdminTestJSON-111361220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd95f195-1e3c-469d-8dab-e5afb4f36380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-388191052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6091555-0caf-4d17-9f30-a7a14b73d46b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5c0060b0d948378790b04a8d746a01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:26:01Z,use_quota=True,user_id='64fb34379de64977b61c471b9e723729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-6690ec34-fb80-476d-a12a-2aec2757c48d tempest-VolumeQuotasAdminTestJSON-111361220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5adcd10d-04c9-476c-a5be-d637ce3ad609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-6690ec34-fb80-476d-a12a-2aec2757c48d tempest-VolumeQuotasAdminTestJSON-111361220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5adcd10d-04c9-476c-a5be-d637ce3ad609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-6690ec34-fb80-476d-a12a-2aec2757c48d tempest-VolumeQuotasAdminTestJSON-111361220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9136bf70-bde2-44e4-b916-9c11a01101e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-6690ec34-fb80-476d-a12a-2aec2757c48d tempest-VolumeQuotasAdminTestJSON-111361220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9136bf70-bde2-44e4-b916-9c11a01101e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6091555-0caf-4d17-9f30-a7a14b73d46b', 'volume_name': 'volume-c6091555-0caf-4d17-9f30-a7a14b73d46b', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-6690ec34-fb80-476d-a12a-2aec2757c48d tempest-VolumeQuotasAdminTestJSON-111361220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac5d183-da5c-4e8f-97d0-7682f1f8cbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-6690ec34-fb80-476d-a12a-2aec2757c48d tempest-VolumeQuotasAdminTestJSON-111361220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac5d183-da5c-4e8f-97d0-7682f1f8cbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-6690ec34-fb80-476d-a12a-2aec2757c48d tempest-VolumeQuotasAdminTestJSON-111361220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92234336-792f-47aa-b375-db8ddc903d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:01 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-6690ec34-fb80-476d-a12a-2aec2757c48d tempest-VolumeQuotasAdminTestJSON-111361220 None] Volume c6091555-0caf-4d17-9f30-a7a14b73d46b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6091555-0caf-4d17-9f30-a7a14b73d46b', 'volume_size': 1}
Apr 02 10:26:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-6690ec34-fb80-476d-a12a-2aec2757c48d tempest-VolumeQuotasAdminTestJSON-111361220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:26:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-6690ec34-fb80-476d-a12a-2aec2757c48d tempest-VolumeQuotasAdminTestJSON-111361220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:26:01 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-6690ec34-fb80-476d-a12a-2aec2757c48d tempest-VolumeQuotasAdminTestJSON-111361220 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-388191052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6091555-0caf-4d17-9f30-a7a14b73d46b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5c0060b0d948378790b04a8d746a01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:26:01Z,use_quota=True,user_id='64fb34379de64977b61c471b9e723729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:26:01 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-6690ec34-fb80-476d-a12a-2aec2757c48d tempest-VolumeQuotasAdminTestJSON-111361220 None] Creating volume c6091555-0caf-4d17-9f30-a7a14b73d46b {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:26:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-6690ec34-fb80-476d-a12a-2aec2757c48d tempest-VolumeQuotasAdminTestJSON-111361220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:26:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-6690ec34-fb80-476d-a12a-2aec2757c48d tempest-VolumeQuotasAdminTestJSON-111361220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:26:01 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-6690ec34-fb80-476d-a12a-2aec2757c48d tempest-VolumeQuotasAdminTestJSON-111361220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:26:01 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-6690ec34-fb80-476d-a12a-2aec2757c48d tempest-VolumeQuotasAdminTestJSON-111361220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:26:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-6690ec34-fb80-476d-a12a-2aec2757c48d tempest-VolumeQuotasAdminTestJSON-111361220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:26:01 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-6690ec34-fb80-476d-a12a-2aec2757c48d tempest-VolumeQuotasAdminTestJSON-111361220 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:26:01 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-6690ec34-fb80-476d-a12a-2aec2757c48d tempest-VolumeQuotasAdminTestJSON-111361220 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:26:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6690ec34-fb80-476d-a12a-2aec2757c48d tempest-VolumeQuotasAdminTestJSON-111361220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c6091555-0caf-4d17-9f30-a7a14b73d46b 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:01 devstack sudo[83592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c6091555-0caf-4d17-9f30-a7a14b73d46b 1073741824
Apr 02 10:26:01 devstack sudo[83592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:02 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-9020dd81-f41d-433e-9731-da1bf4f6412f tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:26:02 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-9020dd81-f41d-433e-9731-da1bf4f6412f tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Flow 'volume_create_manager' (02341d6a-b35f-4c83-aa23-62cdbdbfbc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:26:02 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-9020dd81-f41d-433e-9731-da1bf4f6412f tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abf9d2f5-cf9a-430b-abad-5a81a5d22697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:02 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-9020dd81-f41d-433e-9731-da1bf4f6412f tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abf9d2f5-cf9a-430b-abad-5a81a5d22697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:26:02Z,deleted=False,deleted_at=None,display_description='',display_name='515b46fc-9c2b-46fb-8ea1-3d8a9c4368fd-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=139c024d-474a-4f27-ad01-b43a7f6f7eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af18d76a2c2944d2b74a750e7dbbc2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:26:02Z,use_quota=True,user_id='5dc477cddeb04c1e9699cbbe7485783d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:02 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-9020dd81-f41d-433e-9731-da1bf4f6412f tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfef6955-5dba-4cd0-86e9-0368a43127f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:02 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-9020dd81-f41d-433e-9731-da1bf4f6412f tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfef6955-5dba-4cd0-86e9-0368a43127f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:02 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-9020dd81-f41d-433e-9731-da1bf4f6412f tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef122c8f-3456-4e14-a3db-ae5bf21d1690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:02 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-9020dd81-f41d-433e-9731-da1bf4f6412f tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef122c8f-3456-4e14-a3db-ae5bf21d1690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '139c024d-474a-4f27-ad01-b43a7f6f7eca', 'volume_name': 'volume-139c024d-474a-4f27-ad01-b43a7f6f7eca', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:02 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-9020dd81-f41d-433e-9731-da1bf4f6412f tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f7e388-2c02-4a50-8ff8-2071b45a9aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:02 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-9020dd81-f41d-433e-9731-da1bf4f6412f tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f7e388-2c02-4a50-8ff8-2071b45a9aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:02 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-9020dd81-f41d-433e-9731-da1bf4f6412f tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b3e352-9453-45ee-b8c9-0573062d755c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:02 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-9020dd81-f41d-433e-9731-da1bf4f6412f tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Volume 139c024d-474a-4f27-ad01-b43a7f6f7eca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-139c024d-474a-4f27-ad01-b43a7f6f7eca', 'volume_size': 1}
Apr 02 10:26:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-9020dd81-f41d-433e-9731-da1bf4f6412f tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:26:02 devstack sudo[83592]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6690ec34-fb80-476d-a12a-2aec2757c48d tempest-VolumeQuotasAdminTestJSON-111361220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c6091555-0caf-4d17-9f30-a7a14b73d46b 1073741824" returned: 0 in 1.265s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6690ec34-fb80-476d-a12a-2aec2757c48d tempest-VolumeQuotasAdminTestJSON-111361220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c6091555-0caf-4d17-9f30-a7a14b73d46b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:02 devstack sudo[83597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c6091555-0caf-4d17-9f30-a7a14b73d46b
Apr 02 10:26:02 devstack sudo[83597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:03 devstack sudo[83597]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6690ec34-fb80-476d-a12a-2aec2757c48d tempest-VolumeQuotasAdminTestJSON-111361220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c6091555-0caf-4d17-9f30-a7a14b73d46b" returned: 0 in 0.820s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:03 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-6690ec34-fb80-476d-a12a-2aec2757c48d tempest-VolumeQuotasAdminTestJSON-111361220 None] <== create_volume: return (2138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:26:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-6690ec34-fb80-476d-a12a-2aec2757c48d tempest-VolumeQuotasAdminTestJSON-111361220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.141s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:26:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-9020dd81-f41d-433e-9731-da1bf4f6412f tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.258s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:26:03 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-9020dd81-f41d-433e-9731-da1bf4f6412f tempest-ServerBootFromVolumeStableRescueTest-182334840 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:26:02Z,deleted=False,deleted_at=None,display_description='',display_name='515b46fc-9c2b-46fb-8ea1-3d8a9c4368fd-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=139c024d-474a-4f27-ad01-b43a7f6f7eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af18d76a2c2944d2b74a750e7dbbc2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:26:02Z,use_quota=True,user_id='5dc477cddeb04c1e9699cbbe7485783d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:26:03 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-9020dd81-f41d-433e-9731-da1bf4f6412f tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Creating volume 139c024d-474a-4f27-ad01-b43a7f6f7eca {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:26:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-9020dd81-f41d-433e-9731-da1bf4f6412f tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:26:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-9020dd81-f41d-433e-9731-da1bf4f6412f tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:26:03 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-9020dd81-f41d-433e-9731-da1bf4f6412f tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:26:03 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-9020dd81-f41d-433e-9731-da1bf4f6412f tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:26:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-9020dd81-f41d-433e-9731-da1bf4f6412f tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:26:03 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-9020dd81-f41d-433e-9731-da1bf4f6412f tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:26:03 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-9020dd81-f41d-433e-9731-da1bf4f6412f tempest-ServerBootFromVolumeStableRescueTest-182334840 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:26:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-9020dd81-f41d-433e-9731-da1bf4f6412f tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-139c024d-474a-4f27-ad01-b43a7f6f7eca 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:03 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-6690ec34-fb80-476d-a12a-2aec2757c48d tempest-VolumeQuotasAdminTestJSON-111361220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92234336-792f-47aa-b375-db8ddc903d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6091555-0caf-4d17-9f30-a7a14b73d46b', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:03 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-6690ec34-fb80-476d-a12a-2aec2757c48d tempest-VolumeQuotasAdminTestJSON-111361220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a00b8250-f401-4441-9919-091b4b5a0002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:03 devstack sudo[83601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-139c024d-474a-4f27-ad01-b43a7f6f7eca 1073741824
Apr 02 10:26:03 devstack sudo[83601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:03 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-6690ec34-fb80-476d-a12a-2aec2757c48d tempest-VolumeQuotasAdminTestJSON-111361220 None] Volume volume-c6091555-0caf-4d17-9f30-a7a14b73d46b (c6091555-0caf-4d17-9f30-a7a14b73d46b): created successfully
Apr 02 10:26:03 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-6690ec34-fb80-476d-a12a-2aec2757c48d tempest-VolumeQuotasAdminTestJSON-111361220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a00b8250-f401-4441-9919-091b4b5a0002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:03 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-6690ec34-fb80-476d-a12a-2aec2757c48d tempest-VolumeQuotasAdminTestJSON-111361220 None] Flow 'volume_create_manager' (a467c1d4-b57f-429c-a5a2-18ec37edb2ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:26:03 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-6690ec34-fb80-476d-a12a-2aec2757c48d tempest-VolumeQuotasAdminTestJSON-111361220 None] Created volume successfully.
Apr 02 10:26:04 devstack sudo[83601]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-9020dd81-f41d-433e-9731-da1bf4f6412f tempest-ServerBootFromVolumeStableRescueTest-182334840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-139c024d-474a-4f27-ad01-b43a7f6f7eca 1073741824" returned: 0 in 0.761s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-9020dd81-f41d-433e-9731-da1bf4f6412f tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-139c024d-474a-4f27-ad01-b43a7f6f7eca {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:04 devstack sudo[83607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-139c024d-474a-4f27-ad01-b43a7f6f7eca
Apr 02 10:26:04 devstack sudo[83607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:04 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a63bd9f8-33a0-4ee8-983b-5b0c56abd5d4 tempest-VolumeQuotasAdminTestJSON-111361220 None] Acquiring lock "cinder-c6091555-0caf-4d17-9f30-a7a14b73d46b-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:26:04 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a63bd9f8-33a0-4ee8-983b-5b0c56abd5d4 tempest-VolumeQuotasAdminTestJSON-111361220 None] Lock "cinder-c6091555-0caf-4d17-9f30-a7a14b73d46b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:26:04 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a63bd9f8-33a0-4ee8-983b-5b0c56abd5d4 tempest-VolumeQuotasAdminTestJSON-111361220 None] Acquiring lock "cinder-quobyte-c6091555-0caf-4d17-9f30-a7a14b73d46b" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:26:04 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a63bd9f8-33a0-4ee8-983b-5b0c56abd5d4 tempest-VolumeQuotasAdminTestJSON-111361220 None] Lock "cinder-quobyte-c6091555-0caf-4d17-9f30-a7a14b73d46b" acquired by "delete_volume" :: waited 0.015s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:26:04 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b25f93-af65-4841-b3b6-3f5bbb288aed]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:26:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a63bd9f8-33a0-4ee8-983b-5b0c56abd5d4 tempest-VolumeQuotasAdminTestJSON-111361220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c6091555-0caf-4d17-9f30-a7a14b73d46b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:04 devstack sudo[83610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c6091555-0caf-4d17-9f30-a7a14b73d46b
Apr 02 10:26:04 devstack sudo[83610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:05 devstack sudo[83610]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a63bd9f8-33a0-4ee8-983b-5b0c56abd5d4 tempest-VolumeQuotasAdminTestJSON-111361220 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c6091555-0caf-4d17-9f30-a7a14b73d46b" returned: 0 in 0.844s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a63bd9f8-33a0-4ee8-983b-5b0c56abd5d4 tempest-VolumeQuotasAdminTestJSON-111361220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c6091555-0caf-4d17-9f30-a7a14b73d46b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:05 devstack sudo[83607]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-9020dd81-f41d-433e-9731-da1bf4f6412f tempest-ServerBootFromVolumeStableRescueTest-182334840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-139c024d-474a-4f27-ad01-b43a7f6f7eca" returned: 0 in 1.113s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:05 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-9020dd81-f41d-433e-9731-da1bf4f6412f tempest-ServerBootFromVolumeStableRescueTest-182334840 None] <== create_volume: return (1913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:26:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-9020dd81-f41d-433e-9731-da1bf4f6412f tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.916s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:26:05 devstack sudo[83635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c6091555-0caf-4d17-9f30-a7a14b73d46b
Apr 02 10:26:05 devstack sudo[83635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:05 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-9020dd81-f41d-433e-9731-da1bf4f6412f tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b3e352-9453-45ee-b8c9-0573062d755c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-139c024d-474a-4f27-ad01-b43a7f6f7eca', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:05 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-9020dd81-f41d-433e-9731-da1bf4f6412f tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a04ebf4-2ec9-4703-83b4-e27b71544bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:05 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-9020dd81-f41d-433e-9731-da1bf4f6412f tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Volume volume-139c024d-474a-4f27-ad01-b43a7f6f7eca (139c024d-474a-4f27-ad01-b43a7f6f7eca): created successfully
Apr 02 10:26:05 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-9020dd81-f41d-433e-9731-da1bf4f6412f tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a04ebf4-2ec9-4703-83b4-e27b71544bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:05 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-9020dd81-f41d-433e-9731-da1bf4f6412f tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Flow 'volume_create_manager' (02341d6a-b35f-4c83-aa23-62cdbdbfbc3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:26:05 devstack cinder-volume[82102]: INFO cinder.volume.manager [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-9020dd81-f41d-433e-9731-da1bf4f6412f tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Created volume successfully.
Apr 02 10:26:06 devstack sudo[83635]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a63bd9f8-33a0-4ee8-983b-5b0c56abd5d4 tempest-VolumeQuotasAdminTestJSON-111361220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c6091555-0caf-4d17-9f30-a7a14b73d46b" returned: 0 in 0.592s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:06 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a63bd9f8-33a0-4ee8-983b-5b0c56abd5d4 tempest-VolumeQuotasAdminTestJSON-111361220 None] Lock "cinder-quobyte-c6091555-0caf-4d17-9f30-a7a14b73d46b" released by "delete_volume" :: held 1.473s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:26:06 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-a63bd9f8-33a0-4ee8-983b-5b0c56abd5d4 tempest-VolumeQuotasAdminTestJSON-111361220 None] Created reservations ['16e36ab7-6593-4a97-9bb4-a137f91a72c9', 'd4d1ce22-66bc-4b0e-9c1a-c04a2bec64bf', 'e6ef5c3e-ef5b-4fcd-a7d2-405635b1e952', '9c309594-3206-4d4f-9021-a3b7c515e08b'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:26:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a63bd9f8-33a0-4ee8-983b-5b0c56abd5d4 tempest-VolumeQuotasAdminTestJSON-111361220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:26:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a63bd9f8-33a0-4ee8-983b-5b0c56abd5d4 tempest-VolumeQuotasAdminTestJSON-111361220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:26:06 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-a63bd9f8-33a0-4ee8-983b-5b0c56abd5d4 tempest-VolumeQuotasAdminTestJSON-111361220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:26:06 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-a63bd9f8-33a0-4ee8-983b-5b0c56abd5d4 tempest-VolumeQuotasAdminTestJSON-111361220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:26:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a63bd9f8-33a0-4ee8-983b-5b0c56abd5d4 tempest-VolumeQuotasAdminTestJSON-111361220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:26:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a63bd9f8-33a0-4ee8-983b-5b0c56abd5d4 tempest-VolumeQuotasAdminTestJSON-111361220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:06 devstack sudo[83640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:26:06 devstack sudo[83640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:06 devstack sudo[83640]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a63bd9f8-33a0-4ee8-983b-5b0c56abd5d4 tempest-VolumeQuotasAdminTestJSON-111361220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.598s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:06 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-a63bd9f8-33a0-4ee8-983b-5b0c56abd5d4 tempest-VolumeQuotasAdminTestJSON-111361220 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:26:06 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-a63bd9f8-33a0-4ee8-983b-5b0c56abd5d4 tempest-VolumeQuotasAdminTestJSON-111361220 None] Deleted volume successfully.
Apr 02 10:26:06 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a63bd9f8-33a0-4ee8-983b-5b0c56abd5d4 tempest-VolumeQuotasAdminTestJSON-111361220 None] Lock "cinder-c6091555-0caf-4d17-9f30-a7a14b73d46b-delete_volume" released by "delete_volume" :: held 2.297s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:26:07 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-70af2723-199d-4a6d-89aa-8a7478a9d366 tempest-VolumeQuotasAdminTestJSON-111361220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:26:07 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-70af2723-199d-4a6d-89aa-8a7478a9d366 tempest-VolumeQuotasAdminTestJSON-111361220 None] Flow 'volume_create_manager' (7cdb2d03-cb44-4ebd-8167-1125ab276351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:26:07 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-70af2723-199d-4a6d-89aa-8a7478a9d366 tempest-VolumeQuotasAdminTestJSON-111361220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d943a26f-b4f0-4109-ba04-71233cab87a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:07 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-70af2723-199d-4a6d-89aa-8a7478a9d366 tempest-VolumeQuotasAdminTestJSON-111361220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d943a26f-b4f0-4109-ba04-71233cab87a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1695594894',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dd10894-fd23-4a3f-8904-d830586989be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5c0060b0d948378790b04a8d746a01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:26:07Z,use_quota=True,user_id='64fb34379de64977b61c471b9e723729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:07 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-70af2723-199d-4a6d-89aa-8a7478a9d366 tempest-VolumeQuotasAdminTestJSON-111361220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8fcb44d-8cd6-4de2-adc5-37f7e5ad9e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:07 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-70af2723-199d-4a6d-89aa-8a7478a9d366 tempest-VolumeQuotasAdminTestJSON-111361220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8fcb44d-8cd6-4de2-adc5-37f7e5ad9e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:07 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-70af2723-199d-4a6d-89aa-8a7478a9d366 tempest-VolumeQuotasAdminTestJSON-111361220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9477cb1-5a57-4135-b9d9-939d3f425304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:07 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-70af2723-199d-4a6d-89aa-8a7478a9d366 tempest-VolumeQuotasAdminTestJSON-111361220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9477cb1-5a57-4135-b9d9-939d3f425304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dd10894-fd23-4a3f-8904-d830586989be', 'volume_name': 'volume-2dd10894-fd23-4a3f-8904-d830586989be', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:07 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-70af2723-199d-4a6d-89aa-8a7478a9d366 tempest-VolumeQuotasAdminTestJSON-111361220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8722e25e-9856-464c-8aee-64b48e4bad4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:07 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-70af2723-199d-4a6d-89aa-8a7478a9d366 tempest-VolumeQuotasAdminTestJSON-111361220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8722e25e-9856-464c-8aee-64b48e4bad4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:07 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-70af2723-199d-4a6d-89aa-8a7478a9d366 tempest-VolumeQuotasAdminTestJSON-111361220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c43134-aa81-4c53-90b5-3d778945db26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:07 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-70af2723-199d-4a6d-89aa-8a7478a9d366 tempest-VolumeQuotasAdminTestJSON-111361220 None] Volume 2dd10894-fd23-4a3f-8904-d830586989be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dd10894-fd23-4a3f-8904-d830586989be', 'volume_size': 1}
Apr 02 10:26:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-70af2723-199d-4a6d-89aa-8a7478a9d366 tempest-VolumeQuotasAdminTestJSON-111361220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:26:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-70af2723-199d-4a6d-89aa-8a7478a9d366 tempest-VolumeQuotasAdminTestJSON-111361220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:26:07 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-70af2723-199d-4a6d-89aa-8a7478a9d366 tempest-VolumeQuotasAdminTestJSON-111361220 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1695594894',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dd10894-fd23-4a3f-8904-d830586989be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d5c0060b0d948378790b04a8d746a01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:26:07Z,use_quota=True,user_id='64fb34379de64977b61c471b9e723729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:26:07 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-70af2723-199d-4a6d-89aa-8a7478a9d366 tempest-VolumeQuotasAdminTestJSON-111361220 None] Creating volume 2dd10894-fd23-4a3f-8904-d830586989be {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:26:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-70af2723-199d-4a6d-89aa-8a7478a9d366 tempest-VolumeQuotasAdminTestJSON-111361220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:26:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-70af2723-199d-4a6d-89aa-8a7478a9d366 tempest-VolumeQuotasAdminTestJSON-111361220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:26:07 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-70af2723-199d-4a6d-89aa-8a7478a9d366 tempest-VolumeQuotasAdminTestJSON-111361220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:26:07 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-70af2723-199d-4a6d-89aa-8a7478a9d366 tempest-VolumeQuotasAdminTestJSON-111361220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:26:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-70af2723-199d-4a6d-89aa-8a7478a9d366 tempest-VolumeQuotasAdminTestJSON-111361220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:26:07 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-70af2723-199d-4a6d-89aa-8a7478a9d366 tempest-VolumeQuotasAdminTestJSON-111361220 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:26:07 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-70af2723-199d-4a6d-89aa-8a7478a9d366 tempest-VolumeQuotasAdminTestJSON-111361220 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:26:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-70af2723-199d-4a6d-89aa-8a7478a9d366 tempest-VolumeQuotasAdminTestJSON-111361220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2dd10894-fd23-4a3f-8904-d830586989be 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:07 devstack sudo[83669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2dd10894-fd23-4a3f-8904-d830586989be 1073741824
Apr 02 10:26:07 devstack sudo[83669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:07 devstack sudo[83669]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-70af2723-199d-4a6d-89aa-8a7478a9d366 tempest-VolumeQuotasAdminTestJSON-111361220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2dd10894-fd23-4a3f-8904-d830586989be 1073741824" returned: 0 in 0.587s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-70af2723-199d-4a6d-89aa-8a7478a9d366 tempest-VolumeQuotasAdminTestJSON-111361220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2dd10894-fd23-4a3f-8904-d830586989be {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:07 devstack sudo[83675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2dd10894-fd23-4a3f-8904-d830586989be
Apr 02 10:26:07 devstack sudo[83675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:08 devstack sudo[83675]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-70af2723-199d-4a6d-89aa-8a7478a9d366 tempest-VolumeQuotasAdminTestJSON-111361220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2dd10894-fd23-4a3f-8904-d830586989be" returned: 0 in 0.528s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-70af2723-199d-4a6d-89aa-8a7478a9d366 tempest-VolumeQuotasAdminTestJSON-111361220 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:26:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-70af2723-199d-4a6d-89aa-8a7478a9d366 tempest-VolumeQuotasAdminTestJSON-111361220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:26:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-70af2723-199d-4a6d-89aa-8a7478a9d366 tempest-VolumeQuotasAdminTestJSON-111361220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c43134-aa81-4c53-90b5-3d778945db26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dd10894-fd23-4a3f-8904-d830586989be', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-70af2723-199d-4a6d-89aa-8a7478a9d366 tempest-VolumeQuotasAdminTestJSON-111361220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9bc7122-9531-4815-8e1a-805ad24ea25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:08 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-70af2723-199d-4a6d-89aa-8a7478a9d366 tempest-VolumeQuotasAdminTestJSON-111361220 None] Volume volume-2dd10894-fd23-4a3f-8904-d830586989be (2dd10894-fd23-4a3f-8904-d830586989be): created successfully
Apr 02 10:26:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-70af2723-199d-4a6d-89aa-8a7478a9d366 tempest-VolumeQuotasAdminTestJSON-111361220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9bc7122-9531-4815-8e1a-805ad24ea25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-70af2723-199d-4a6d-89aa-8a7478a9d366 tempest-VolumeQuotasAdminTestJSON-111361220 None] Flow 'volume_create_manager' (7cdb2d03-cb44-4ebd-8167-1125ab276351) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:26:08 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-70af2723-199d-4a6d-89aa-8a7478a9d366 tempest-VolumeQuotasAdminTestJSON-111361220 None] Created volume successfully.
Apr 02 10:26:08 devstack cinder-volume[82102]: DEBUG oslo_service.periodic_task [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 02 10:26:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:26:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:26:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:26:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:26:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:26:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:08 devstack sudo[83680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:26:08 devstack sudo[83680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:09 devstack sudo[83680]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.668s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:09 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:26:10 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-2be6b597-bea3-40f1-9a87-831665811622 tempest-VolumeQuotasAdminTestJSON-1437623936 None] Transfer volume completed successfully.
Apr 02 10:26:10 devstack cinder-volume[82102]: WARNING py.warnings [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-b971be5a-a3fd-43d8-ac0d-3eafc8c0607e tempest-ServerBootFromVolumeStableRescueTest-182334840 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Apr 02 10:26:10 devstack cinder-volume[82102]:   .first()
Apr 02 10:26:10 devstack cinder-volume[82102]: 
Apr 02 10:26:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-b971be5a-a3fd-43d8-ac0d-3eafc8c0607e tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:26:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-b971be5a-a3fd-43d8-ac0d-3eafc8c0607e tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:26:10 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[08154968-5727-4999-9936-8f305ed1a404]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:26:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-b971be5a-a3fd-43d8-ac0d-3eafc8c0607e tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-139c024d-474a-4f27-ad01-b43a7f6f7eca {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:11 devstack sudo[83697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-139c024d-474a-4f27-ad01-b43a7f6f7eca
Apr 02 10:26:11 devstack sudo[83697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:11 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a7d1a643-6c82-42f8-94fd-73d4900a50e5 tempest-VolumeQuotasAdminTestJSON-43595933 None] Acquiring lock "cinder-2dd10894-fd23-4a3f-8904-d830586989be-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:26:11 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a7d1a643-6c82-42f8-94fd-73d4900a50e5 tempest-VolumeQuotasAdminTestJSON-43595933 None] Lock "cinder-2dd10894-fd23-4a3f-8904-d830586989be-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:26:11 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a7d1a643-6c82-42f8-94fd-73d4900a50e5 tempest-VolumeQuotasAdminTestJSON-43595933 None] Acquiring lock "cinder-quobyte-2dd10894-fd23-4a3f-8904-d830586989be" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:26:11 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a7d1a643-6c82-42f8-94fd-73d4900a50e5 tempest-VolumeQuotasAdminTestJSON-43595933 None] Lock "cinder-quobyte-2dd10894-fd23-4a3f-8904-d830586989be" acquired by "delete_volume" :: waited 0.024s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:26:11 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4181936-171e-4cf1-9531-ba635cc02661]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:26:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a7d1a643-6c82-42f8-94fd-73d4900a50e5 tempest-VolumeQuotasAdminTestJSON-43595933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2dd10894-fd23-4a3f-8904-d830586989be {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:12 devstack sudo[83725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2dd10894-fd23-4a3f-8904-d830586989be
Apr 02 10:26:12 devstack sudo[83725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:12 devstack sudo[83697]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-b971be5a-a3fd-43d8-ac0d-3eafc8c0607e tempest-ServerBootFromVolumeStableRescueTest-182334840 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-139c024d-474a-4f27-ad01-b43a7f6f7eca" returned: 0 in 1.691s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-b971be5a-a3fd-43d8-ac0d-3eafc8c0607e tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.707s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:26:12 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-b971be5a-a3fd-43d8-ac0d-3eafc8c0607e tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091', 'name': 'volume-139c024d-474a-4f27-ad01-b43a7f6f7eca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8fcb11f8-0dc6-403d-a2e3-02c382e0206f', 'enforce_multipath': True} {{(pid=82102) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 02 10:26:12 devstack cinder-volume[82102]: INFO cinder.volume.manager [req-c0426637-6ec8-4490-8dec-34d96d4ead7b req-b971be5a-a3fd-43d8-ac0d-3eafc8c0607e tempest-ServerBootFromVolumeStableRescueTest-182334840 None] attachment_update completed successfully.
Apr 02 10:26:12 devstack sudo[83725]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a7d1a643-6c82-42f8-94fd-73d4900a50e5 tempest-VolumeQuotasAdminTestJSON-43595933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2dd10894-fd23-4a3f-8904-d830586989be" returned: 0 in 1.143s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a7d1a643-6c82-42f8-94fd-73d4900a50e5 tempest-VolumeQuotasAdminTestJSON-43595933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2dd10894-fd23-4a3f-8904-d830586989be {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:12 devstack sudo[83736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2dd10894-fd23-4a3f-8904-d830586989be
Apr 02 10:26:12 devstack sudo[83736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:13 devstack sudo[83736]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a7d1a643-6c82-42f8-94fd-73d4900a50e5 tempest-VolumeQuotasAdminTestJSON-43595933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2dd10894-fd23-4a3f-8904-d830586989be" returned: 0 in 0.960s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:13 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a7d1a643-6c82-42f8-94fd-73d4900a50e5 tempest-VolumeQuotasAdminTestJSON-43595933 None] Lock "cinder-quobyte-2dd10894-fd23-4a3f-8904-d830586989be" released by "delete_volume" :: held 2.168s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:26:13 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-a7d1a643-6c82-42f8-94fd-73d4900a50e5 tempest-VolumeQuotasAdminTestJSON-43595933 None] Created reservations ['f724db7c-1223-4b3c-95eb-7d4fe6ad896e', '26ea3a6c-e28e-4546-aa6e-629955c3e671', 'fa8dcce2-06cf-4ef3-a335-4829dd6e1dba', '2b0f7988-b536-4f91-ae48-662f837186db'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:26:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a7d1a643-6c82-42f8-94fd-73d4900a50e5 tempest-VolumeQuotasAdminTestJSON-43595933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:26:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a7d1a643-6c82-42f8-94fd-73d4900a50e5 tempest-VolumeQuotasAdminTestJSON-43595933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:26:13 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-a7d1a643-6c82-42f8-94fd-73d4900a50e5 tempest-VolumeQuotasAdminTestJSON-43595933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:26:13 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-a7d1a643-6c82-42f8-94fd-73d4900a50e5 tempest-VolumeQuotasAdminTestJSON-43595933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:26:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a7d1a643-6c82-42f8-94fd-73d4900a50e5 tempest-VolumeQuotasAdminTestJSON-43595933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:26:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a7d1a643-6c82-42f8-94fd-73d4900a50e5 tempest-VolumeQuotasAdminTestJSON-43595933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:13 devstack sudo[83739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:26:13 devstack sudo[83739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:14 devstack sudo[83739]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a7d1a643-6c82-42f8-94fd-73d4900a50e5 tempest-VolumeQuotasAdminTestJSON-43595933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.863s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:14 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-a7d1a643-6c82-42f8-94fd-73d4900a50e5 tempest-VolumeQuotasAdminTestJSON-43595933 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:26:14 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-a7d1a643-6c82-42f8-94fd-73d4900a50e5 tempest-VolumeQuotasAdminTestJSON-43595933 None] Deleted volume successfully.
Apr 02 10:26:14 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a7d1a643-6c82-42f8-94fd-73d4900a50e5 tempest-VolumeQuotasAdminTestJSON-43595933 None] Lock "cinder-2dd10894-fd23-4a3f-8904-d830586989be-delete_volume" released by "delete_volume" :: held 3.507s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:26:15 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-e64da531-ca36-48cb-9ad5-7906df2bb4bd tempest-DeleteServersTestJSON-457599923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:26:15 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e64da531-ca36-48cb-9ad5-7906df2bb4bd tempest-DeleteServersTestJSON-457599923 None] Flow 'volume_create_manager' (2ac378f3-cda7-4bb5-80a2-c591b9fd54af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:26:15 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e64da531-ca36-48cb-9ad5-7906df2bb4bd tempest-DeleteServersTestJSON-457599923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5125f8f5-2bda-4dbe-8c7d-38902f96bd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:15 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e64da531-ca36-48cb-9ad5-7906df2bb4bd tempest-DeleteServersTestJSON-457599923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5125f8f5-2bda-4dbe-8c7d-38902f96bd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1286683497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bc5b12a-a71c-4daa-89c2-015234de3fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f98dcc0ec9348d7997064fcae43a0da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:26:15Z,use_quota=True,user_id='442d77d6d3104f39b8b9bbe42cd2e4b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:15 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e64da531-ca36-48cb-9ad5-7906df2bb4bd tempest-DeleteServersTestJSON-457599923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (803e5986-1501-4c05-b0ba-f2e07c748c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:15 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e64da531-ca36-48cb-9ad5-7906df2bb4bd tempest-DeleteServersTestJSON-457599923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (803e5986-1501-4c05-b0ba-f2e07c748c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:15 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e64da531-ca36-48cb-9ad5-7906df2bb4bd tempest-DeleteServersTestJSON-457599923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b48ed779-8428-4af0-8fdd-283903ddf846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:15 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e64da531-ca36-48cb-9ad5-7906df2bb4bd tempest-DeleteServersTestJSON-457599923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b48ed779-8428-4af0-8fdd-283903ddf846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bc5b12a-a71c-4daa-89c2-015234de3fe5', 'volume_name': 'volume-5bc5b12a-a71c-4daa-89c2-015234de3fe5', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:15 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e64da531-ca36-48cb-9ad5-7906df2bb4bd tempest-DeleteServersTestJSON-457599923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (250e03f7-1fdf-4f72-b9a3-4cf760498a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:15 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e64da531-ca36-48cb-9ad5-7906df2bb4bd tempest-DeleteServersTestJSON-457599923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (250e03f7-1fdf-4f72-b9a3-4cf760498a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:15 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e64da531-ca36-48cb-9ad5-7906df2bb4bd tempest-DeleteServersTestJSON-457599923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44fe6ba8-4bbe-480a-9fd7-d3cde8c74be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:15 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-e64da531-ca36-48cb-9ad5-7906df2bb4bd tempest-DeleteServersTestJSON-457599923 None] Volume 5bc5b12a-a71c-4daa-89c2-015234de3fe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bc5b12a-a71c-4daa-89c2-015234de3fe5', 'volume_size': 1}
Apr 02 10:26:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e64da531-ca36-48cb-9ad5-7906df2bb4bd tempest-DeleteServersTestJSON-457599923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:26:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e64da531-ca36-48cb-9ad5-7906df2bb4bd tempest-DeleteServersTestJSON-457599923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:26:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e64da531-ca36-48cb-9ad5-7906df2bb4bd tempest-DeleteServersTestJSON-457599923 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1286683497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bc5b12a-a71c-4daa-89c2-015234de3fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f98dcc0ec9348d7997064fcae43a0da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:26:15Z,use_quota=True,user_id='442d77d6d3104f39b8b9bbe42cd2e4b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:26:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-e64da531-ca36-48cb-9ad5-7906df2bb4bd tempest-DeleteServersTestJSON-457599923 None] Creating volume 5bc5b12a-a71c-4daa-89c2-015234de3fe5 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:26:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e64da531-ca36-48cb-9ad5-7906df2bb4bd tempest-DeleteServersTestJSON-457599923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:26:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e64da531-ca36-48cb-9ad5-7906df2bb4bd tempest-DeleteServersTestJSON-457599923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:26:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e64da531-ca36-48cb-9ad5-7906df2bb4bd tempest-DeleteServersTestJSON-457599923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:26:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e64da531-ca36-48cb-9ad5-7906df2bb4bd tempest-DeleteServersTestJSON-457599923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:26:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e64da531-ca36-48cb-9ad5-7906df2bb4bd tempest-DeleteServersTestJSON-457599923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:26:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e64da531-ca36-48cb-9ad5-7906df2bb4bd tempest-DeleteServersTestJSON-457599923 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:26:15 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-e64da531-ca36-48cb-9ad5-7906df2bb4bd tempest-DeleteServersTestJSON-457599923 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:26:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e64da531-ca36-48cb-9ad5-7906df2bb4bd tempest-DeleteServersTestJSON-457599923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-5bc5b12a-a71c-4daa-89c2-015234de3fe5 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:15 devstack sudo[83790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-5bc5b12a-a71c-4daa-89c2-015234de3fe5 1073741824
Apr 02 10:26:15 devstack sudo[83790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:16 devstack sudo[83790]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e64da531-ca36-48cb-9ad5-7906df2bb4bd tempest-DeleteServersTestJSON-457599923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-5bc5b12a-a71c-4daa-89c2-015234de3fe5 1073741824" returned: 0 in 1.081s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e64da531-ca36-48cb-9ad5-7906df2bb4bd tempest-DeleteServersTestJSON-457599923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-5bc5b12a-a71c-4daa-89c2-015234de3fe5 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:16 devstack sudo[83817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-5bc5b12a-a71c-4daa-89c2-015234de3fe5
Apr 02 10:26:16 devstack sudo[83817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:17 devstack sudo[83817]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e64da531-ca36-48cb-9ad5-7906df2bb4bd tempest-DeleteServersTestJSON-457599923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-5bc5b12a-a71c-4daa-89c2-015234de3fe5" returned: 0 in 0.809s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:17 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e64da531-ca36-48cb-9ad5-7906df2bb4bd tempest-DeleteServersTestJSON-457599923 None] <== create_volume: return (1958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:26:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e64da531-ca36-48cb-9ad5-7906df2bb4bd tempest-DeleteServersTestJSON-457599923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.960s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:26:17 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e64da531-ca36-48cb-9ad5-7906df2bb4bd tempest-DeleteServersTestJSON-457599923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44fe6ba8-4bbe-480a-9fd7-d3cde8c74be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bc5b12a-a71c-4daa-89c2-015234de3fe5', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:17 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e64da531-ca36-48cb-9ad5-7906df2bb4bd tempest-DeleteServersTestJSON-457599923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10fbdc68-02a2-4d4f-a802-8ae5a7c51120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:17 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-e64da531-ca36-48cb-9ad5-7906df2bb4bd tempest-DeleteServersTestJSON-457599923 None] Volume volume-5bc5b12a-a71c-4daa-89c2-015234de3fe5 (5bc5b12a-a71c-4daa-89c2-015234de3fe5): created successfully
Apr 02 10:26:17 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e64da531-ca36-48cb-9ad5-7906df2bb4bd tempest-DeleteServersTestJSON-457599923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10fbdc68-02a2-4d4f-a802-8ae5a7c51120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:17 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e64da531-ca36-48cb-9ad5-7906df2bb4bd tempest-DeleteServersTestJSON-457599923 None] Flow 'volume_create_manager' (2ac378f3-cda7-4bb5-80a2-c591b9fd54af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:26:17 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-e64da531-ca36-48cb-9ad5-7906df2bb4bd tempest-DeleteServersTestJSON-457599923 None] Created volume successfully.
Apr 02 10:26:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-70fc899c-8ea0-431c-8f8c-775f1e469454 req-d2e2451e-cdf6-4fc9-9e5b-2aa7ae6f9971 tempest-DeleteServersTestJSON-457599923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:26:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-70fc899c-8ea0-431c-8f8c-775f1e469454 req-d2e2451e-cdf6-4fc9-9e5b-2aa7ae6f9971 tempest-DeleteServersTestJSON-457599923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:26:21 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c362377-30e9-444c-8089-8f2b16ee422d]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:26:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-70fc899c-8ea0-431c-8f8c-775f1e469454 req-d2e2451e-cdf6-4fc9-9e5b-2aa7ae6f9971 tempest-DeleteServersTestJSON-457599923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-5bc5b12a-a71c-4daa-89c2-015234de3fe5 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:22 devstack sudo[84172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-5bc5b12a-a71c-4daa-89c2-015234de3fe5
Apr 02 10:26:22 devstack sudo[84172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:22 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0d25f1e-46c2-4f2e-9904-66e0cab86de3 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:26:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b0d25f1e-46c2-4f2e-9904-66e0cab86de3 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Flow 'volume_create_manager' (5d970791-85c7-41e3-b82d-1a392ee80b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:26:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b0d25f1e-46c2-4f2e-9904-66e0cab86de3 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f1f8e07-a138-4564-94ca-4843a9a3334b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b0d25f1e-46c2-4f2e-9904-66e0cab86de3 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f1f8e07-a138-4564-94ca-4843a9a3334b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1520736733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9cd6d83de524bc1b251fac03406bb70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:26:22Z,use_quota=True,user_id='c90cb1fa1c8641168851b57efc6d1bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b0d25f1e-46c2-4f2e-9904-66e0cab86de3 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4191f758-991b-4daf-80f7-7b40753be598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b0d25f1e-46c2-4f2e-9904-66e0cab86de3 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4191f758-991b-4daf-80f7-7b40753be598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b0d25f1e-46c2-4f2e-9904-66e0cab86de3 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6abdc5f8-c9a7-41fe-a776-0383e3d13bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b0d25f1e-46c2-4f2e-9904-66e0cab86de3 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6abdc5f8-c9a7-41fe-a776-0383e3d13bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521', 'volume_name': 'volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b0d25f1e-46c2-4f2e-9904-66e0cab86de3 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f99f0ed-e67c-4fb9-ae7f-968667bcd318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b0d25f1e-46c2-4f2e-9904-66e0cab86de3 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f99f0ed-e67c-4fb9-ae7f-968667bcd318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b0d25f1e-46c2-4f2e-9904-66e0cab86de3 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (583533d8-74f1-4d07-b64f-c19e92dad985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:22 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-b0d25f1e-46c2-4f2e-9904-66e0cab86de3 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Volume f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521', 'volume_size': 1}
Apr 02 10:26:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-b0d25f1e-46c2-4f2e-9904-66e0cab86de3 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:26:22 devstack sudo[84172]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-70fc899c-8ea0-431c-8f8c-775f1e469454 req-d2e2451e-cdf6-4fc9-9e5b-2aa7ae6f9971 tempest-DeleteServersTestJSON-457599923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-5bc5b12a-a71c-4daa-89c2-015234de3fe5" returned: 0 in 0.813s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-70fc899c-8ea0-431c-8f8c-775f1e469454 req-d2e2451e-cdf6-4fc9-9e5b-2aa7ae6f9971 tempest-DeleteServersTestJSON-457599923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.854s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:26:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-b0d25f1e-46c2-4f2e-9904-66e0cab86de3 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.179s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:26:22 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-b0d25f1e-46c2-4f2e-9904-66e0cab86de3 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1520736733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9cd6d83de524bc1b251fac03406bb70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:26:22Z,use_quota=True,user_id='c90cb1fa1c8641168851b57efc6d1bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:26:22 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-b0d25f1e-46c2-4f2e-9904-66e0cab86de3 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Creating volume f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:26:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-b0d25f1e-46c2-4f2e-9904-66e0cab86de3 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:26:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-b0d25f1e-46c2-4f2e-9904-66e0cab86de3 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:26:22 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-b0d25f1e-46c2-4f2e-9904-66e0cab86de3 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:26:22 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-b0d25f1e-46c2-4f2e-9904-66e0cab86de3 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:26:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-b0d25f1e-46c2-4f2e-9904-66e0cab86de3 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:26:22 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-b0d25f1e-46c2-4f2e-9904-66e0cab86de3 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:26:22 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-b0d25f1e-46c2-4f2e-9904-66e0cab86de3 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:26:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b0d25f1e-46c2-4f2e-9904-66e0cab86de3 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:22 devstack sudo[84177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521 1073741824
Apr 02 10:26:22 devstack sudo[84177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-70fc899c-8ea0-431c-8f8c-775f1e469454 req-d2e2451e-cdf6-4fc9-9e5b-2aa7ae6f9971 tempest-DeleteServersTestJSON-457599923 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091', 'name': 'volume-5bc5b12a-a71c-4daa-89c2-015234de3fe5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cb77577c-67cc-4f38-b330-23be4f45a75d', 'enforce_multipath': True} {{(pid=82102) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 02 10:26:22 devstack cinder-volume[82102]: INFO cinder.volume.manager [req-70fc899c-8ea0-431c-8f8c-775f1e469454 req-d2e2451e-cdf6-4fc9-9e5b-2aa7ae6f9971 tempest-DeleteServersTestJSON-457599923 None] attachment_update completed successfully.
Apr 02 10:26:23 devstack sudo[84177]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b0d25f1e-46c2-4f2e-9904-66e0cab86de3 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521 1073741824" returned: 0 in 0.733s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b0d25f1e-46c2-4f2e-9904-66e0cab86de3 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:23 devstack sudo[84183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521
Apr 02 10:26:23 devstack sudo[84183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:24 devstack sudo[84183]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b0d25f1e-46c2-4f2e-9904-66e0cab86de3 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521" returned: 0 in 0.585s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:24 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-b0d25f1e-46c2-4f2e-9904-66e0cab86de3 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:26:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-b0d25f1e-46c2-4f2e-9904-66e0cab86de3 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:26:24 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b0d25f1e-46c2-4f2e-9904-66e0cab86de3 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (583533d8-74f1-4d07-b64f-c19e92dad985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:24 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b0d25f1e-46c2-4f2e-9904-66e0cab86de3 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dcedc2a-f17e-4003-b956-f70fc278c50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:24 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-b0d25f1e-46c2-4f2e-9904-66e0cab86de3 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Volume volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521 (f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521): created successfully
Apr 02 10:26:24 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b0d25f1e-46c2-4f2e-9904-66e0cab86de3 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dcedc2a-f17e-4003-b956-f70fc278c50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:24 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b0d25f1e-46c2-4f2e-9904-66e0cab86de3 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Flow 'volume_create_manager' (5d970791-85c7-41e3-b82d-1a392ee80b50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:26:24 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-b0d25f1e-46c2-4f2e-9904-66e0cab86de3 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Created volume successfully.
Apr 02 10:26:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-0d2a4c73-f6a8-440b-bd1d-5ab966d229ca tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:26:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-0d2a4c73-f6a8-440b-bd1d-5ab966d229ca tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:26:24 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-0d2a4c73-f6a8-440b-bd1d-5ab966d229ca tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Creating offline snapshot 985b944e-5201-4322-a2c4-f28e7e11bac3 of volume f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521 {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:26:24 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[494c8e0d-810f-44df-af70-b95728a479c5]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:26:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0d2a4c73-f6a8-440b-bd1d-5ab966d229ca tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:24 devstack sudo[84206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521
Apr 02 10:26:24 devstack sudo[84206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:25 devstack sudo[84206]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0d2a4c73-f6a8-440b-bd1d-5ab966d229ca tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521" returned: 0 in 0.477s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0d2a4c73-f6a8-440b-bd1d-5ab966d229ca tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521.985b944e-5201-4322-a2c4-f28e7e11bac3 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:25 devstack sudo[84211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521.985b944e-5201-4322-a2c4-f28e7e11bac3 1G
Apr 02 10:26:25 devstack sudo[84211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:25 devstack sudo[84211]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0d2a4c73-f6a8-440b-bd1d-5ab966d229ca tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521.985b944e-5201-4322-a2c4-f28e7e11bac3 1G" returned: 0 in 0.719s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0d2a4c73-f6a8-440b-bd1d-5ab966d229ca tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521.985b944e-5201-4322-a2c4-f28e7e11bac3 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:25 devstack sudo[84217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521.985b944e-5201-4322-a2c4-f28e7e11bac3
Apr 02 10:26:25 devstack sudo[84217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:26 devstack sudo[84217]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0d2a4c73-f6a8-440b-bd1d-5ab966d229ca tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521.985b944e-5201-4322-a2c4-f28e7e11bac3" returned: 0 in 0.427s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:26 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-0d2a4c73-f6a8-440b-bd1d-5ab966d229ca tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521.985b944e-5201-4322-a2c4-f28e7e11bac3 is being set with open permissions: ugo+rw
Apr 02 10:26:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0d2a4c73-f6a8-440b-bd1d-5ab966d229ca tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521.985b944e-5201-4322-a2c4-f28e7e11bac3 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:26 devstack sudo[84222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521.985b944e-5201-4322-a2c4-f28e7e11bac3
Apr 02 10:26:26 devstack sudo[84222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:27 devstack sudo[84222]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0d2a4c73-f6a8-440b-bd1d-5ab966d229ca tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521.985b944e-5201-4322-a2c4-f28e7e11bac3" returned: 0 in 0.806s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0d2a4c73-f6a8-440b-bd1d-5ab966d229ca tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:27 devstack sudo[84254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521.info
Apr 02 10:26:27 devstack sudo[84254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:27 devstack sudo[84254]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0d2a4c73-f6a8-440b-bd1d-5ab966d229ca tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521.info" returned: 0 in 0.520s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:27 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-0d2a4c73-f6a8-440b-bd1d-5ab966d229ca tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521.info is being set with open permissions: ugo+rw
Apr 02 10:26:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0d2a4c73-f6a8-440b-bd1d-5ab966d229ca tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:27 devstack sudo[84258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521.info
Apr 02 10:26:27 devstack sudo[84258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:28 devstack sudo[84258]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0d2a4c73-f6a8-440b-bd1d-5ab966d229ca tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521.info" returned: 0 in 0.431s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-0d2a4c73-f6a8-440b-bd1d-5ab966d229ca tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.463s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:26:28 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-0d2a4c73-f6a8-440b-bd1d-5ab966d229ca tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Create snapshot completed successfully
Apr 02 10:26:29 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-85ee98f6-1c1c-47ac-b0ee-3093facb3951 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Acquiring lock "cinder-985b944e-5201-4322-a2c4-f28e7e11bac3-delete_snapshot" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:26:29 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-85ee98f6-1c1c-47ac-b0ee-3093facb3951 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Lock "cinder-985b944e-5201-4322-a2c4-f28e7e11bac3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:26:29 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-85ee98f6-1c1c-47ac-b0ee-3093facb3951 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Acquiring lock "cinder-quobyte-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:26:29 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-85ee98f6-1c1c-47ac-b0ee-3093facb3951 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Lock "cinder-quobyte-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:26:29 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-85ee98f6-1c1c-47ac-b0ee-3093facb3951 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Acquiring lock "cinder-quobyte-985b944e-5201-4322-a2c4-f28e7e11bac3" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:26:29 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-85ee98f6-1c1c-47ac-b0ee-3093facb3951 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Lock "cinder-quobyte-985b944e-5201-4322-a2c4-f28e7e11bac3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:26:29 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-85ee98f6-1c1c-47ac-b0ee-3093facb3951 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Deleting offline snapshot 985b944e-5201-4322-a2c4-f28e7e11bac3 of volume f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:26:29 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-85ee98f6-1c1c-47ac-b0ee-3093facb3951 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] snapshot_file for this snap is: volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521.985b944e-5201-4322-a2c4-f28e7e11bac3 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:26:29 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee19d90-8e2b-474e-b4e8-3edabc176760]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:26:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-85ee98f6-1c1c-47ac-b0ee-3093facb3951 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521.985b944e-5201-4322-a2c4-f28e7e11bac3 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:29 devstack sudo[84388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521.985b944e-5201-4322-a2c4-f28e7e11bac3
Apr 02 10:26:29 devstack sudo[84388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:30 devstack sudo[84388]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-85ee98f6-1c1c-47ac-b0ee-3093facb3951 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521.985b944e-5201-4322-a2c4-f28e7e11bac3" returned: 0 in 0.591s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:30 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-85ee98f6-1c1c-47ac-b0ee-3093facb3951 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:26:30 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[51245f9e-b80b-43fc-ad65-cf9cf5a88dca]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:26:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-85ee98f6-1c1c-47ac-b0ee-3093facb3951 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:30 devstack sudo[84394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521
Apr 02 10:26:30 devstack sudo[84394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:30 devstack sudo[84394]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-85ee98f6-1c1c-47ac-b0ee-3093facb3951 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521" returned: 0 in 0.629s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-85ee98f6-1c1c-47ac-b0ee-3093facb3951 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521.985b944e-5201-4322-a2c4-f28e7e11bac3 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:30 devstack sudo[84466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521.985b944e-5201-4322-a2c4-f28e7e11bac3
Apr 02 10:26:30 devstack sudo[84466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:31 devstack sudo[84466]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-85ee98f6-1c1c-47ac-b0ee-3093facb3951 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521.985b944e-5201-4322-a2c4-f28e7e11bac3" returned: 0 in 0.508s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-85ee98f6-1c1c-47ac-b0ee-3093facb3951 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521.985b944e-5201-4322-a2c4-f28e7e11bac3 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:31 devstack sudo[84472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521.985b944e-5201-4322-a2c4-f28e7e11bac3
Apr 02 10:26:31 devstack sudo[84472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:31 devstack cinder-volume[82102]: INFO cinder.volume.manager [req-a4eb0277-f884-4acb-920f-e74686455894 req-8340db2b-b291-41d8-b971-2b30551cc173 tempest-DeleteServersTestJSON-457599923 None] Terminate volume connection completed successfully.
Apr 02 10:26:31 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-a4eb0277-f884-4acb-920f-e74686455894 req-8340db2b-b291-41d8-b971-2b30551cc173 tempest-DeleteServersTestJSON-457599923 None] Deleting attachment cb77577c-67cc-4f38-b330-23be4f45a75d. {{(pid=82102) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 02 10:26:31 devstack sudo[84472]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-85ee98f6-1c1c-47ac-b0ee-3093facb3951 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521.985b944e-5201-4322-a2c4-f28e7e11bac3" returned: 0 in 0.412s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:31 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-85ee98f6-1c1c-47ac-b0ee-3093facb3951 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Lock "cinder-quobyte-985b944e-5201-4322-a2c4-f28e7e11bac3" released by "_delete_snapshot" :: held 2.220s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:26:31 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-85ee98f6-1c1c-47ac-b0ee-3093facb3951 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Lock "cinder-quobyte-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521" released by "delete_snapshot" :: held 2.243s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:26:31 devstack cinder-volume[82102]: WARNING cinder.quota [None req-85ee98f6-1c1c-47ac-b0ee-3093facb3951 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 02 10:26:31 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-85ee98f6-1c1c-47ac-b0ee-3093facb3951 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Created reservations ['360e2283-d6ac-4762-b6c4-2b6df7cfc7f7', 'ca4a0de3-1bf5-457e-9313-d17d4decb41f', '88cb5057-7425-43ba-82d2-f6b45a5a54ca', '286eb439-5841-4b1c-96e0-c4db7dc2029c'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:26:31 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-85ee98f6-1c1c-47ac-b0ee-3093facb3951 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Delete snapshot completed successfully.
Apr 02 10:26:31 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-85ee98f6-1c1c-47ac-b0ee-3093facb3951 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Lock "cinder-985b944e-5201-4322-a2c4-f28e7e11bac3-delete_snapshot" released by "delete_snapshot" :: held 2.355s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:26:32 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-dc23ca9f-187b-4131-aa12-8f6eefed2739 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Acquiring lock "cinder-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:26:32 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-dc23ca9f-187b-4131-aa12-8f6eefed2739 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Lock "cinder-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:26:32 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-dc23ca9f-187b-4131-aa12-8f6eefed2739 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Acquiring lock "cinder-quobyte-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:26:32 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-dc23ca9f-187b-4131-aa12-8f6eefed2739 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Lock "cinder-quobyte-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521" acquired by "delete_volume" :: waited 0.015s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:26:32 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4cc858-ade3-46a2-9ae2-9bc8d5fccd72]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:26:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-dc23ca9f-187b-4131-aa12-8f6eefed2739 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:32 devstack sudo[84478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521
Apr 02 10:26:32 devstack sudo[84478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:33 devstack sudo[84478]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-dc23ca9f-187b-4131-aa12-8f6eefed2739 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521" returned: 0 in 0.630s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-dc23ca9f-187b-4131-aa12-8f6eefed2739 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:33 devstack sudo[84819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521
Apr 02 10:26:33 devstack sudo[84819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:34 devstack sudo[84819]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-dc23ca9f-187b-4131-aa12-8f6eefed2739 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521" returned: 0 in 0.666s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:34 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-dc23ca9f-187b-4131-aa12-8f6eefed2739 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Lock "cinder-quobyte-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521" released by "delete_volume" :: held 1.360s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:26:34 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-dc23ca9f-187b-4131-aa12-8f6eefed2739 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Created reservations ['a7c74a14-c111-46c6-9ddb-5f3dc40249c1', '67ea267e-f346-4d02-ba1e-12b175b647b7', '89d102fb-06f1-41f6-a0f8-725030721ddd', 'dfd2afe8-447e-46bb-b2d8-d5d666089538'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:26:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-dc23ca9f-187b-4131-aa12-8f6eefed2739 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:26:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-dc23ca9f-187b-4131-aa12-8f6eefed2739 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:26:34 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-dc23ca9f-187b-4131-aa12-8f6eefed2739 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:26:34 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-dc23ca9f-187b-4131-aa12-8f6eefed2739 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:26:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-dc23ca9f-187b-4131-aa12-8f6eefed2739 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:26:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-dc23ca9f-187b-4131-aa12-8f6eefed2739 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:34 devstack sudo[84825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:26:34 devstack sudo[84825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:34 devstack sudo[84825]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-dc23ca9f-187b-4131-aa12-8f6eefed2739 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.507s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:34 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-dc23ca9f-187b-4131-aa12-8f6eefed2739 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:26:34 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-dc23ca9f-187b-4131-aa12-8f6eefed2739 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Deleted volume successfully.
Apr 02 10:26:34 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-dc23ca9f-187b-4131-aa12-8f6eefed2739 tempest-VolumeSnapshotQuotasNegativeTestJSON-322723642 None] Lock "cinder-f259e6fc-6b5b-4ccc-80af-d7cd6fcc9521-delete_volume" released by "delete_volume" :: held 2.013s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:26:35 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-db587cd9-0578-4906-9853-b781e562e98a tempest-DeleteServersTestJSON-457599923 None] Acquiring lock "cinder-5bc5b12a-a71c-4daa-89c2-015234de3fe5-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:26:35 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-db587cd9-0578-4906-9853-b781e562e98a tempest-DeleteServersTestJSON-457599923 None] Lock "cinder-5bc5b12a-a71c-4daa-89c2-015234de3fe5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:26:35 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-db587cd9-0578-4906-9853-b781e562e98a tempest-DeleteServersTestJSON-457599923 None] Acquiring lock "cinder-quobyte-5bc5b12a-a71c-4daa-89c2-015234de3fe5" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:26:35 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-db587cd9-0578-4906-9853-b781e562e98a tempest-DeleteServersTestJSON-457599923 None] Lock "cinder-quobyte-5bc5b12a-a71c-4daa-89c2-015234de3fe5" acquired by "delete_volume" :: waited 0.022s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:26:35 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7393dd1-1681-4b21-a2de-0a4b4d594bb1]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:26:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-db587cd9-0578-4906-9853-b781e562e98a tempest-DeleteServersTestJSON-457599923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-5bc5b12a-a71c-4daa-89c2-015234de3fe5 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:35 devstack sudo[84828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-5bc5b12a-a71c-4daa-89c2-015234de3fe5
Apr 02 10:26:35 devstack sudo[84828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:35 devstack sudo[84828]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-db587cd9-0578-4906-9853-b781e562e98a tempest-DeleteServersTestJSON-457599923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-5bc5b12a-a71c-4daa-89c2-015234de3fe5" returned: 0 in 0.599s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-db587cd9-0578-4906-9853-b781e562e98a tempest-DeleteServersTestJSON-457599923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-5bc5b12a-a71c-4daa-89c2-015234de3fe5 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:35 devstack sudo[84833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-5bc5b12a-a71c-4daa-89c2-015234de3fe5
Apr 02 10:26:35 devstack sudo[84833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:36 devstack sudo[84833]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-db587cd9-0578-4906-9853-b781e562e98a tempest-DeleteServersTestJSON-457599923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-5bc5b12a-a71c-4daa-89c2-015234de3fe5" returned: 0 in 0.551s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:36 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-db587cd9-0578-4906-9853-b781e562e98a tempest-DeleteServersTestJSON-457599923 None] Lock "cinder-quobyte-5bc5b12a-a71c-4daa-89c2-015234de3fe5" released by "delete_volume" :: held 1.182s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:26:36 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-db587cd9-0578-4906-9853-b781e562e98a tempest-DeleteServersTestJSON-457599923 None] Created reservations ['b43a13a7-40a7-462a-9820-7ed083b0dc85', '85d424f0-8c39-4232-a704-b9ef03bffb3c', '407bb49f-9431-4658-9a94-0bf1d615afda', '1031e3c1-dfa5-4561-a74e-b1e8e9d6fcb7'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:26:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-db587cd9-0578-4906-9853-b781e562e98a tempest-DeleteServersTestJSON-457599923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:26:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-db587cd9-0578-4906-9853-b781e562e98a tempest-DeleteServersTestJSON-457599923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:26:36 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-db587cd9-0578-4906-9853-b781e562e98a tempest-DeleteServersTestJSON-457599923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:26:36 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-db587cd9-0578-4906-9853-b781e562e98a tempest-DeleteServersTestJSON-457599923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:26:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-db587cd9-0578-4906-9853-b781e562e98a tempest-DeleteServersTestJSON-457599923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:26:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-db587cd9-0578-4906-9853-b781e562e98a tempest-DeleteServersTestJSON-457599923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:36 devstack sudo[84836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:26:36 devstack sudo[84836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:37 devstack sudo[84836]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-db587cd9-0578-4906-9853-b781e562e98a tempest-DeleteServersTestJSON-457599923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.630s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:37 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-db587cd9-0578-4906-9853-b781e562e98a tempest-DeleteServersTestJSON-457599923 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:26:37 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-db587cd9-0578-4906-9853-b781e562e98a tempest-DeleteServersTestJSON-457599923 None] Deleted volume successfully.
Apr 02 10:26:37 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-db587cd9-0578-4906-9853-b781e562e98a tempest-DeleteServersTestJSON-457599923 None] Lock "cinder-5bc5b12a-a71c-4daa-89c2-015234de3fe5-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:26:45 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-66c90899-d08c-4f6b-b7a3-b20d711b57ce tempest-GroupSnapshotsV319Test-1906589605 None] Group tempest-GroupSnapshotsV319Test-Group-372365965: creating
Apr 02 10:26:45 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-66c90899-d08c-4f6b-b7a3-b20d711b57ce tempest-GroupSnapshotsV319Test-1906589605 None] Group tempest-GroupSnapshotsV319Test-Group-372365965: created successfully
Apr 02 10:26:45 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-66c90899-d08c-4f6b-b7a3-b20d711b57ce tempest-GroupSnapshotsV319Test-1906589605 None] Create group completed successfully.
Apr 02 10:26:48 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8b66b7d-6487-4a9e-8367-2d7bb710b2e2 tempest-GroupSnapshotsV319Test-1906589605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:26:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c8b66b7d-6487-4a9e-8367-2d7bb710b2e2 tempest-GroupSnapshotsV319Test-1906589605 None] Flow 'volume_create_manager' (1a5b535c-d32c-444a-a3ef-55442f9032a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:26:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c8b66b7d-6487-4a9e-8367-2d7bb710b2e2 tempest-GroupSnapshotsV319Test-1906589605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f27c280f-468c-45bf-af74-c30ac05e4f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c8b66b7d-6487-4a9e-8367-2d7bb710b2e2 tempest-GroupSnapshotsV319Test-1906589605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f27c280f-468c-45bf-af74-c30ac05e4f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-157798414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d0ec951c-eb04-4565-ae4e-6188bbd6c369,host='devstack@QuobyteHD#QuobyteHD',id=bbd77634-f83f-4f11-af2f-1b11770b812e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e898c3d837f44b4a8238828682b98a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:26:48Z,use_quota=True,user_id='e7953d3dfe064e008c651035a7076418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54923557-867c-4546-bb45-2e40daeb55f7),volume_type_id=54923557-867c-4546-bb45-2e40daeb55f7)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c8b66b7d-6487-4a9e-8367-2d7bb710b2e2 tempest-GroupSnapshotsV319Test-1906589605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c26a611-a8f1-493b-b93d-62f3ac1320be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c8b66b7d-6487-4a9e-8367-2d7bb710b2e2 tempest-GroupSnapshotsV319Test-1906589605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c26a611-a8f1-493b-b93d-62f3ac1320be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c8b66b7d-6487-4a9e-8367-2d7bb710b2e2 tempest-GroupSnapshotsV319Test-1906589605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3fda0ae-ebcf-4b64-8d2f-241f53b7f206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c8b66b7d-6487-4a9e-8367-2d7bb710b2e2 tempest-GroupSnapshotsV319Test-1906589605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3fda0ae-ebcf-4b64-8d2f-241f53b7f206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbd77634-f83f-4f11-af2f-1b11770b812e', 'volume_name': 'volume-bbd77634-f83f-4f11-af2f-1b11770b812e', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c8b66b7d-6487-4a9e-8367-2d7bb710b2e2 tempest-GroupSnapshotsV319Test-1906589605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6012dd80-b402-44e5-8506-4337b5957208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c8b66b7d-6487-4a9e-8367-2d7bb710b2e2 tempest-GroupSnapshotsV319Test-1906589605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6012dd80-b402-44e5-8506-4337b5957208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c8b66b7d-6487-4a9e-8367-2d7bb710b2e2 tempest-GroupSnapshotsV319Test-1906589605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a19e82c-c5bc-4f2e-83c9-a774a52b3a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:48 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-c8b66b7d-6487-4a9e-8367-2d7bb710b2e2 tempest-GroupSnapshotsV319Test-1906589605 None] Volume bbd77634-f83f-4f11-af2f-1b11770b812e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbd77634-f83f-4f11-af2f-1b11770b812e', 'volume_size': 1}
Apr 02 10:26:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-c8b66b7d-6487-4a9e-8367-2d7bb710b2e2 tempest-GroupSnapshotsV319Test-1906589605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:26:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-c8b66b7d-6487-4a9e-8367-2d7bb710b2e2 tempest-GroupSnapshotsV319Test-1906589605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:26:48 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-c8b66b7d-6487-4a9e-8367-2d7bb710b2e2 tempest-GroupSnapshotsV319Test-1906589605 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d0ec951c-eb04-4565-ae4e-6188bbd6c369,created_at=2026-04-02T08:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-157798414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d0ec951c-eb04-4565-ae4e-6188bbd6c369,host='devstack@QuobyteHD#QuobyteHD',id=bbd77634-f83f-4f11-af2f-1b11770b812e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e898c3d837f44b4a8238828682b98a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:26:48Z,use_quota=True,user_id='e7953d3dfe064e008c651035a7076418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54923557-867c-4546-bb45-2e40daeb55f7),volume_type_id=54923557-867c-4546-bb45-2e40daeb55f7)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:26:48 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-c8b66b7d-6487-4a9e-8367-2d7bb710b2e2 tempest-GroupSnapshotsV319Test-1906589605 None] Creating volume bbd77634-f83f-4f11-af2f-1b11770b812e {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:26:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-c8b66b7d-6487-4a9e-8367-2d7bb710b2e2 tempest-GroupSnapshotsV319Test-1906589605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:26:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-c8b66b7d-6487-4a9e-8367-2d7bb710b2e2 tempest-GroupSnapshotsV319Test-1906589605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:26:48 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-c8b66b7d-6487-4a9e-8367-2d7bb710b2e2 tempest-GroupSnapshotsV319Test-1906589605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:26:48 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-c8b66b7d-6487-4a9e-8367-2d7bb710b2e2 tempest-GroupSnapshotsV319Test-1906589605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:26:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-c8b66b7d-6487-4a9e-8367-2d7bb710b2e2 tempest-GroupSnapshotsV319Test-1906589605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:26:48 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-c8b66b7d-6487-4a9e-8367-2d7bb710b2e2 tempest-GroupSnapshotsV319Test-1906589605 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:26:48 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-c8b66b7d-6487-4a9e-8367-2d7bb710b2e2 tempest-GroupSnapshotsV319Test-1906589605 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:26:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c8b66b7d-6487-4a9e-8367-2d7bb710b2e2 tempest-GroupSnapshotsV319Test-1906589605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:48 devstack sudo[84980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e 1073741824
Apr 02 10:26:48 devstack sudo[84980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:49 devstack sudo[84980]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c8b66b7d-6487-4a9e-8367-2d7bb710b2e2 tempest-GroupSnapshotsV319Test-1906589605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e 1073741824" returned: 0 in 0.971s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c8b66b7d-6487-4a9e-8367-2d7bb710b2e2 tempest-GroupSnapshotsV319Test-1906589605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:49 devstack sudo[85007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e
Apr 02 10:26:49 devstack sudo[85007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:50 devstack sudo[85007]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c8b66b7d-6487-4a9e-8367-2d7bb710b2e2 tempest-GroupSnapshotsV319Test-1906589605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e" returned: 0 in 0.884s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:50 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-c8b66b7d-6487-4a9e-8367-2d7bb710b2e2 tempest-GroupSnapshotsV319Test-1906589605 None] <== create_volume: return (1893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:26:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-c8b66b7d-6487-4a9e-8367-2d7bb710b2e2 tempest-GroupSnapshotsV319Test-1906589605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:26:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c8b66b7d-6487-4a9e-8367-2d7bb710b2e2 tempest-GroupSnapshotsV319Test-1906589605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a19e82c-c5bc-4f2e-83c9-a774a52b3a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbd77634-f83f-4f11-af2f-1b11770b812e', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c8b66b7d-6487-4a9e-8367-2d7bb710b2e2 tempest-GroupSnapshotsV319Test-1906589605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0ce1af2-dbd4-4896-b376-88d7e8b6af0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:50 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-c8b66b7d-6487-4a9e-8367-2d7bb710b2e2 tempest-GroupSnapshotsV319Test-1906589605 None] Volume volume-bbd77634-f83f-4f11-af2f-1b11770b812e (bbd77634-f83f-4f11-af2f-1b11770b812e): created successfully
Apr 02 10:26:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c8b66b7d-6487-4a9e-8367-2d7bb710b2e2 tempest-GroupSnapshotsV319Test-1906589605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0ce1af2-dbd4-4896-b376-88d7e8b6af0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c8b66b7d-6487-4a9e-8367-2d7bb710b2e2 tempest-GroupSnapshotsV319Test-1906589605 None] Flow 'volume_create_manager' (1a5b535c-d32c-444a-a3ef-55442f9032a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:26:50 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-c8b66b7d-6487-4a9e-8367-2d7bb710b2e2 tempest-GroupSnapshotsV319Test-1906589605 None] Created volume successfully.
Apr 02 10:26:50 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-a373d05e-d306-48a5-99d2-9d2c26ca0604 tempest-GroupSnapshotsV319Test-1906589605 None] GroupSnapshot 7d911366-b03c-45eb-98e6-fedc0af0ce4d: creating.
Apr 02 10:26:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-a373d05e-d306-48a5-99d2-9d2c26ca0604 tempest-GroupSnapshotsV319Test-1906589605 None] Group snapshot 7d911366-b03c-45eb-98e6-fedc0af0ce4d: creating. {{(pid=82102) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 02 10:26:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a373d05e-d306-48a5-99d2-9d2c26ca0604 tempest-GroupSnapshotsV319Test-1906589605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:26:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a373d05e-d306-48a5-99d2-9d2c26ca0604 tempest-GroupSnapshotsV319Test-1906589605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:26:50 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-a373d05e-d306-48a5-99d2-9d2c26ca0604 tempest-GroupSnapshotsV319Test-1906589605 None] Creating offline snapshot 476ef511-34f9-4938-95c5-7a3cc96dde6b of volume bbd77634-f83f-4f11-af2f-1b11770b812e {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:26:50 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5121383d-90bb-4e09-8a0c-34cbadf2b5ab]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:26:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a373d05e-d306-48a5-99d2-9d2c26ca0604 tempest-GroupSnapshotsV319Test-1906589605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:51 devstack sudo[85053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e
Apr 02 10:26:51 devstack sudo[85053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:51 devstack sudo[85053]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a373d05e-d306-48a5-99d2-9d2c26ca0604 tempest-GroupSnapshotsV319Test-1906589605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e" returned: 0 in 0.634s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a373d05e-d306-48a5-99d2-9d2c26ca0604 tempest-GroupSnapshotsV319Test-1906589605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e.476ef511-34f9-4938-95c5-7a3cc96dde6b 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:51 devstack sudo[85064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e.476ef511-34f9-4938-95c5-7a3cc96dde6b 1G
Apr 02 10:26:51 devstack sudo[85064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:51 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:26:51 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Flow 'volume_create_manager' (2727643d-4696-4040-ab6d-ce7af1e42864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:26:51 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81e07317-e743-444c-ab60-8691ee3f17db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:51 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81e07317-e743-444c-ab60-8691ee3f17db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1594284052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feb47614-2a9a-42af-8173-d33836766d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65eaba2155674fcdb7400e38f540e53f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:26:52Z,use_quota=True,user_id='0132f8ec35b84e569dccee886888777e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:51 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (922ef162-7371-4d59-b18e-2d3aaeae44b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:51 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (922ef162-7371-4d59-b18e-2d3aaeae44b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:51 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (544d0a79-8c97-4478-bd43-6ecc40cf2c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:51 devstack cinder-volume[82102]: DEBUG cinder.image.glance [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Creating Keystone auth plugin from conf {{(pid=82102) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 02 10:26:52 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (544d0a79-8c97-4478-bd43-6ecc40cf2c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'feb47614-2a9a-42af-8173-d33836766d3b', 'volume_name': 'volume-feb47614-2a9a-42af-8173-d33836766d3b', 'volume_size': 1, 'image_id': '100d2cbf-7145-49cd-863b-c1e137045ce3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/100d2cbf-7145-49cd-863b-c1e137045ce3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e7bc1c1d4b5544979a3d9a5428cd3e5d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '100d2cbf-7145-49cd-863b-c1e137045ce3', 'created_at': datetime.datetime(2026, 4, 2, 8, 20, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 8, 20, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/100d2cbf-7145-49cd-863b-c1e137045ce3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f636de3fdc0>}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:52 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea6352a8-40e1-4121-8840-3419b3fb1fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:52 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea6352a8-40e1-4121-8840-3419b3fb1fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:52 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (178bfbb2-a8c0-457a-a7d7-e0c5f6ecaf61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:52 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Volume feb47614-2a9a-42af-8173-d33836766d3b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-feb47614-2a9a-42af-8173-d33836766d3b', 'volume_size': 1, 'image_id': '100d2cbf-7145-49cd-863b-c1e137045ce3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/100d2cbf-7145-49cd-863b-c1e137045ce3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e7bc1c1d4b5544979a3d9a5428cd3e5d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '100d2cbf-7145-49cd-863b-c1e137045ce3', 'created_at': datetime.datetime(2026, 4, 2, 8, 20, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 8, 20, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/100d2cbf-7145-49cd-863b-c1e137045ce3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f636de3fdc0>}
Apr 02 10:26:52 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Trying to clone feb47614-2a9a-42af-8173-d33836766d3b from image 100d2cbf-7145-49cd-863b-c1e137045ce3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/100d2cbf-7145-49cd-863b-c1e137045ce3', 'metadata': {}}]). {{(pid=82102) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 02 10:26:52 devstack sudo[85064]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a373d05e-d306-48a5-99d2-9d2c26ca0604 tempest-GroupSnapshotsV319Test-1906589605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e.476ef511-34f9-4938-95c5-7a3cc96dde6b 1G" returned: 0 in 0.864s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a373d05e-d306-48a5-99d2-9d2c26ca0604 tempest-GroupSnapshotsV319Test-1906589605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbd77634-f83f-4f11-af2f-1b11770b812e -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e.476ef511-34f9-4938-95c5-7a3cc96dde6b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:52 devstack sudo[85090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbd77634-f83f-4f11-af2f-1b11770b812e -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e.476ef511-34f9-4938-95c5-7a3cc96dde6b
Apr 02 10:26:52 devstack sudo[85090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:52 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_vpo9h_tsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82102) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 02 10:26:52 devstack cinder-volume[82102]: INFO cinder.image.image_utils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Image download 20.69 MB at 20.69 MB/s
Apr 02 10:26:52 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c02237-c425-4b0b-b1cb-456abb5e1d07]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:26:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_vpo9h_tsdevstack@QuobyteHD {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:52 devstack sudo[85093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_vpo9h_tsdevstack@QuobyteHD
Apr 02 10:26:52 devstack sudo[85093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:52 devstack sudo[85090]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a373d05e-d306-48a5-99d2-9d2c26ca0604 tempest-GroupSnapshotsV319Test-1906589605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbd77634-f83f-4f11-af2f-1b11770b812e -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e.476ef511-34f9-4938-95c5-7a3cc96dde6b" returned: 0 in 0.572s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:52 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-a373d05e-d306-48a5-99d2-9d2c26ca0604 tempest-GroupSnapshotsV319Test-1906589605 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e.476ef511-34f9-4938-95c5-7a3cc96dde6b is being set with open permissions: ugo+rw: NotImplementedError
Apr 02 10:26:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a373d05e-d306-48a5-99d2-9d2c26ca0604 tempest-GroupSnapshotsV319Test-1906589605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e.476ef511-34f9-4938-95c5-7a3cc96dde6b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:53 devstack sudo[85098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e.476ef511-34f9-4938-95c5-7a3cc96dde6b
Apr 02 10:26:53 devstack sudo[85098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:53 devstack sudo[85093]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_vpo9h_tsdevstack@QuobyteHD" returned: 0 in 0.586s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:53 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Temporary image 100d2cbf-7145-49cd-863b-c1e137045ce3 is fetched for user 0132f8ec35b84e569dccee886888777e. {{(pid=82102) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 02 10:26:53 devstack cinder-volume[82102]: DEBUG dbcounter [-] [82102] Writing DB stats cinder:UPDATE=66,cinder:INSERT=11,cinder:SELECT=54,cinder:DELETE=2 {{(pid=82102) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 02 10:26:53 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[759fcdea-7ed5-498d-b043-dcbd31a4ccf3]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:26:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_vpo9h_tsdevstack@QuobyteHD {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:53 devstack sudo[85106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_vpo9h_tsdevstack@QuobyteHD
Apr 02 10:26:53 devstack sudo[85106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:53 devstack sudo[85098]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a373d05e-d306-48a5-99d2-9d2c26ca0604 tempest-GroupSnapshotsV319Test-1906589605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e.476ef511-34f9-4938-95c5-7a3cc96dde6b" returned: 0 in 0.679s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a373d05e-d306-48a5-99d2-9d2c26ca0604 tempest-GroupSnapshotsV319Test-1906589605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:53 devstack sudo[85109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e.info
Apr 02 10:26:53 devstack sudo[85109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:53 devstack sudo[85106]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_vpo9h_tsdevstack@QuobyteHD" returned: 0 in 0.723s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:26:54 devstack sudo[85109]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a373d05e-d306-48a5-99d2-9d2c26ca0604 tempest-GroupSnapshotsV319Test-1906589605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e.info" returned: 0 in 0.432s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:54 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-a373d05e-d306-48a5-99d2-9d2c26ca0604 tempest-GroupSnapshotsV319Test-1906589605 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 02 10:26:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a373d05e-d306-48a5-99d2-9d2c26ca0604 tempest-GroupSnapshotsV319Test-1906589605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:54 devstack sudo[85115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e.info
Apr 02 10:26:54 devstack sudo[85115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:54 devstack sudo[85115]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a373d05e-d306-48a5-99d2-9d2c26ca0604 tempest-GroupSnapshotsV319Test-1906589605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e.info" returned: 0 in 0.418s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a373d05e-d306-48a5-99d2-9d2c26ca0604 tempest-GroupSnapshotsV319Test-1906589605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.731s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:26:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.632s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:26:54 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1594284052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feb47614-2a9a-42af-8173-d33836766d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65eaba2155674fcdb7400e38f540e53f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:26:52Z,use_quota=True,user_id='0132f8ec35b84e569dccee886888777e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:26:54 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Creating volume feb47614-2a9a-42af-8173-d33836766d3b {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:26:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:26:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:26:54 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:26:54 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:26:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:26:54 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:26:54 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:26:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-feb47614-2a9a-42af-8173-d33836766d3b 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:54 devstack cinder-volume[82102]: DEBUG dbcounter [-] [82102] Writing DB stats cinder:SELECT=66,cinder:UPDATE=58,cinder:DELETE=9,cinder:INSERT=17 {{(pid=82102) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 02 10:26:54 devstack sudo[85118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-feb47614-2a9a-42af-8173-d33836766d3b 1073741824
Apr 02 10:26:54 devstack sudo[85118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:54 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-a373d05e-d306-48a5-99d2-9d2c26ca0604 tempest-GroupSnapshotsV319Test-1906589605 None] group_snapshot 7d911366-b03c-45eb-98e6-fedc0af0ce4d: created successfully
Apr 02 10:26:55 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-bea51b01-0c3e-43bd-ba39-aacc236f218b tempest-ServersNegativeTestJSON-1173775544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:26:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bea51b01-0c3e-43bd-ba39-aacc236f218b tempest-ServersNegativeTestJSON-1173775544 None] Flow 'volume_create_manager' (e3e71c9b-c82d-4d3a-b83e-72cf3a25bfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:26:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bea51b01-0c3e-43bd-ba39-aacc236f218b tempest-ServersNegativeTestJSON-1173775544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb87c0de-23af-4baa-9fcf-dba4f2822750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bea51b01-0c3e-43bd-ba39-aacc236f218b tempest-ServersNegativeTestJSON-1173775544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb87c0de-23af-4baa-9fcf-dba4f2822750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-812082136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f8d17d-40f6-41c8-a52c-598467bcfa6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='213ef1c1e55c47b1a5b8c249a3bad84f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:26:56Z,use_quota=True,user_id='269012757feb4e0b85addd147192d42d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bea51b01-0c3e-43bd-ba39-aacc236f218b tempest-ServersNegativeTestJSON-1173775544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e53dbe-2a72-46ff-9af2-47855ac5ecb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bea51b01-0c3e-43bd-ba39-aacc236f218b tempest-ServersNegativeTestJSON-1173775544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e53dbe-2a72-46ff-9af2-47855ac5ecb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bea51b01-0c3e-43bd-ba39-aacc236f218b tempest-ServersNegativeTestJSON-1173775544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d8daff9-12f8-4618-b2d8-76a2290bd6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bea51b01-0c3e-43bd-ba39-aacc236f218b tempest-ServersNegativeTestJSON-1173775544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d8daff9-12f8-4618-b2d8-76a2290bd6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3f8d17d-40f6-41c8-a52c-598467bcfa6b', 'volume_name': 'volume-e3f8d17d-40f6-41c8-a52c-598467bcfa6b', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bea51b01-0c3e-43bd-ba39-aacc236f218b tempest-ServersNegativeTestJSON-1173775544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3544270-c871-42b4-aa8a-adcee1a60088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bea51b01-0c3e-43bd-ba39-aacc236f218b tempest-ServersNegativeTestJSON-1173775544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3544270-c871-42b4-aa8a-adcee1a60088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bea51b01-0c3e-43bd-ba39-aacc236f218b tempest-ServersNegativeTestJSON-1173775544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b103109-62cd-4c4c-a23d-f85fddd1c882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:55 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-bea51b01-0c3e-43bd-ba39-aacc236f218b tempest-ServersNegativeTestJSON-1173775544 None] Volume e3f8d17d-40f6-41c8-a52c-598467bcfa6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3f8d17d-40f6-41c8-a52c-598467bcfa6b', 'volume_size': 1}
Apr 02 10:26:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bea51b01-0c3e-43bd-ba39-aacc236f218b tempest-ServersNegativeTestJSON-1173775544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:26:55 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-c43ea098-533b-4fa2-8c33-b5e4d347a117 tempest-GroupSnapshotsV319Test-1906589605 None] group_snapshot 7d911366-b03c-45eb-98e6-fedc0af0ce4d: deleting
Apr 02 10:26:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c43ea098-533b-4fa2-8c33-b5e4d347a117 tempest-GroupSnapshotsV319Test-1906589605 None] group_snapshot 7d911366-b03c-45eb-98e6-fedc0af0ce4d: deleting {{(pid=82102) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 02 10:26:55 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c43ea098-533b-4fa2-8c33-b5e4d347a117 tempest-GroupSnapshotsV319Test-1906589605 None] Acquiring lock "cinder-quobyte-bbd77634-f83f-4f11-af2f-1b11770b812e" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:26:55 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c43ea098-533b-4fa2-8c33-b5e4d347a117 tempest-GroupSnapshotsV319Test-1906589605 None] Lock "cinder-quobyte-bbd77634-f83f-4f11-af2f-1b11770b812e" acquired by "delete_snapshot" :: waited 0.029s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:26:55 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c43ea098-533b-4fa2-8c33-b5e4d347a117 tempest-GroupSnapshotsV319Test-1906589605 None] Acquiring lock "cinder-quobyte-476ef511-34f9-4938-95c5-7a3cc96dde6b" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:26:55 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c43ea098-533b-4fa2-8c33-b5e4d347a117 tempest-GroupSnapshotsV319Test-1906589605 None] Lock "cinder-quobyte-476ef511-34f9-4938-95c5-7a3cc96dde6b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:26:55 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-c43ea098-533b-4fa2-8c33-b5e4d347a117 tempest-GroupSnapshotsV319Test-1906589605 None] Deleting offline snapshot 476ef511-34f9-4938-95c5-7a3cc96dde6b of volume bbd77634-f83f-4f11-af2f-1b11770b812e {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:26:55 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-c43ea098-533b-4fa2-8c33-b5e4d347a117 tempest-GroupSnapshotsV319Test-1906589605 None] snapshot_file for this snap is: volume-bbd77634-f83f-4f11-af2f-1b11770b812e.476ef511-34f9-4938-95c5-7a3cc96dde6b {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:26:56 devstack sudo[85118]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-feb47614-2a9a-42af-8173-d33836766d3b 1073741824" returned: 0 in 1.396s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:56 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[727e669a-c51a-4aff-a92b-ea6791abf27d]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:26:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c43ea098-533b-4fa2-8c33-b5e4d347a117 tempest-GroupSnapshotsV319Test-1906589605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e.476ef511-34f9-4938-95c5-7a3cc96dde6b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-feb47614-2a9a-42af-8173-d33836766d3b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:56 devstack sudo[85151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-feb47614-2a9a-42af-8173-d33836766d3b
Apr 02 10:26:56 devstack sudo[85151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:56 devstack sudo[85150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e.476ef511-34f9-4938-95c5-7a3cc96dde6b
Apr 02 10:26:56 devstack sudo[85150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:56 devstack sudo[85151]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-feb47614-2a9a-42af-8173-d33836766d3b" returned: 0 in 0.625s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:56 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] <== create_volume: return (2080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:26:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.087s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:26:56 devstack sudo[85150]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bea51b01-0c3e-43bd-ba39-aacc236f218b tempest-ServersNegativeTestJSON-1173775544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.877s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:26:56 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-bea51b01-0c3e-43bd-ba39-aacc236f218b tempest-ServersNegativeTestJSON-1173775544 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-812082136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f8d17d-40f6-41c8-a52c-598467bcfa6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='213ef1c1e55c47b1a5b8c249a3bad84f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:26:56Z,use_quota=True,user_id='269012757feb4e0b85addd147192d42d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:26:56 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-bea51b01-0c3e-43bd-ba39-aacc236f218b tempest-ServersNegativeTestJSON-1173775544 None] Creating volume e3f8d17d-40f6-41c8-a52c-598467bcfa6b {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:26:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bea51b01-0c3e-43bd-ba39-aacc236f218b tempest-ServersNegativeTestJSON-1173775544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:26:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bea51b01-0c3e-43bd-ba39-aacc236f218b tempest-ServersNegativeTestJSON-1173775544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:26:56 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-bea51b01-0c3e-43bd-ba39-aacc236f218b tempest-ServersNegativeTestJSON-1173775544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:26:56 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-bea51b01-0c3e-43bd-ba39-aacc236f218b tempest-ServersNegativeTestJSON-1173775544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:26:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bea51b01-0c3e-43bd-ba39-aacc236f218b tempest-ServersNegativeTestJSON-1173775544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:26:56 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-bea51b01-0c3e-43bd-ba39-aacc236f218b tempest-ServersNegativeTestJSON-1173775544 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:26:56 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-bea51b01-0c3e-43bd-ba39-aacc236f218b tempest-ServersNegativeTestJSON-1173775544 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:26:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bea51b01-0c3e-43bd-ba39-aacc236f218b tempest-ServersNegativeTestJSON-1173775544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3f8d17d-40f6-41c8-a52c-598467bcfa6b 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c43ea098-533b-4fa2-8c33-b5e4d347a117 tempest-GroupSnapshotsV319Test-1906589605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e.476ef511-34f9-4938-95c5-7a3cc96dde6b" returned: 0 in 0.697s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:56 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-c43ea098-533b-4fa2-8c33-b5e4d347a117 tempest-GroupSnapshotsV319Test-1906589605 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbd77634-f83f-4f11-af2f-1b11770b812e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:26:56 devstack sudo[85159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3f8d17d-40f6-41c8-a52c-598467bcfa6b 1073741824
Apr 02 10:26:56 devstack sudo[85159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:56 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[223ec52f-89ec-4f99-9cd6-cfe8ada8185b]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:26:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c43ea098-533b-4fa2-8c33-b5e4d347a117 tempest-GroupSnapshotsV319Test-1906589605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:56 devstack cinder-volume[82102]: DEBUG cinder.volume.volume_utils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Attempting download of 100d2cbf-7145-49cd-863b-c1e137045ce3 ((None, [{'url': 'file:///opt/stack/data/glance/images/100d2cbf-7145-49cd-863b-c1e137045ce3', 'metadata': {}}])) to volume feb47614-2a9a-42af-8173-d33836766d3b. {{(pid=82102) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 02 10:26:56 devstack sudo[85161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e
Apr 02 10:26:56 devstack sudo[85161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:56 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e493e0b-237e-4e16-aa60-08f497168576]: (4, 'raw') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:26:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_100d2cbf-7145-49cd-863b-c1e137045ce3_iw_mn8i9 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:57 devstack sudo[85163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_100d2cbf-7145-49cd-863b-c1e137045ce3_iw_mn8i9
Apr 02 10:26:57 devstack sudo[85163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:57 devstack sudo[85161]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c43ea098-533b-4fa2-8c33-b5e4d347a117 tempest-GroupSnapshotsV319Test-1906589605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e" returned: 0 in 0.800s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c43ea098-533b-4fa2-8c33-b5e4d347a117 tempest-GroupSnapshotsV319Test-1906589605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e.476ef511-34f9-4938-95c5-7a3cc96dde6b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:57 devstack sudo[85173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e.476ef511-34f9-4938-95c5-7a3cc96dde6b
Apr 02 10:26:57 devstack sudo[85173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:57 devstack sudo[85163]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_100d2cbf-7145-49cd-863b-c1e137045ce3_iw_mn8i9" returned: 0 in 0.717s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_100d2cbf-7145-49cd-863b-c1e137045ce3_iw_mn8i9 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:57 devstack sudo[85175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_100d2cbf-7145-49cd-863b-c1e137045ce3_iw_mn8i9
Apr 02 10:26:57 devstack sudo[85175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:57 devstack sudo[85159]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bea51b01-0c3e-43bd-ba39-aacc236f218b tempest-ServersNegativeTestJSON-1173775544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3f8d17d-40f6-41c8-a52c-598467bcfa6b 1073741824" returned: 0 in 1.089s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bea51b01-0c3e-43bd-ba39-aacc236f218b tempest-ServersNegativeTestJSON-1173775544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3f8d17d-40f6-41c8-a52c-598467bcfa6b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:57 devstack sudo[85177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3f8d17d-40f6-41c8-a52c-598467bcfa6b
Apr 02 10:26:57 devstack sudo[85177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:58 devstack sudo[85175]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_100d2cbf-7145-49cd-863b-c1e137045ce3_iw_mn8i9" returned: 1 in 0.774s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_100d2cbf-7145-49cd-863b-c1e137045ce3_iw_mn8i9' failed. Not Retrying. {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 02 10:26:58 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[300cf756-a633-4944-a0f6-3ae2877d9a37]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:26:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_vpo9h_tsdevstack@QuobyteHD {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:58 devstack sudo[85173]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c43ea098-533b-4fa2-8c33-b5e4d347a117 tempest-GroupSnapshotsV319Test-1906589605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e.476ef511-34f9-4938-95c5-7a3cc96dde6b" returned: 0 in 0.851s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c43ea098-533b-4fa2-8c33-b5e4d347a117 tempest-GroupSnapshotsV319Test-1906589605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e.476ef511-34f9-4938-95c5-7a3cc96dde6b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:58 devstack sudo[85185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e.476ef511-34f9-4938-95c5-7a3cc96dde6b
Apr 02 10:26:58 devstack sudo[85185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:58 devstack sudo[85177]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bea51b01-0c3e-43bd-ba39-aacc236f218b tempest-ServersNegativeTestJSON-1173775544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3f8d17d-40f6-41c8-a52c-598467bcfa6b" returned: 0 in 0.676s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:58 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-bea51b01-0c3e-43bd-ba39-aacc236f218b tempest-ServersNegativeTestJSON-1173775544 None] <== create_volume: return (1827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:26:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bea51b01-0c3e-43bd-ba39-aacc236f218b tempest-ServersNegativeTestJSON-1173775544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.831s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:26:58 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bea51b01-0c3e-43bd-ba39-aacc236f218b tempest-ServersNegativeTestJSON-1173775544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b103109-62cd-4c4c-a23d-f85fddd1c882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3f8d17d-40f6-41c8-a52c-598467bcfa6b', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:58 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bea51b01-0c3e-43bd-ba39-aacc236f218b tempest-ServersNegativeTestJSON-1173775544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f040ead5-cf14-464f-8d9a-8f59c4a0f2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:26:58 devstack sudo[85184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_vpo9h_tsdevstack@QuobyteHD
Apr 02 10:26:58 devstack sudo[85184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:58 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-bea51b01-0c3e-43bd-ba39-aacc236f218b tempest-ServersNegativeTestJSON-1173775544 None] Volume volume-e3f8d17d-40f6-41c8-a52c-598467bcfa6b (e3f8d17d-40f6-41c8-a52c-598467bcfa6b): created successfully
Apr 02 10:26:58 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bea51b01-0c3e-43bd-ba39-aacc236f218b tempest-ServersNegativeTestJSON-1173775544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f040ead5-cf14-464f-8d9a-8f59c4a0f2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:26:58 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bea51b01-0c3e-43bd-ba39-aacc236f218b tempest-ServersNegativeTestJSON-1173775544 None] Flow 'volume_create_manager' (e3e71c9b-c82d-4d3a-b83e-72cf3a25bfd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:26:58 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-bea51b01-0c3e-43bd-ba39-aacc236f218b tempest-ServersNegativeTestJSON-1173775544 None] Created volume successfully.
Apr 02 10:26:59 devstack sudo[85185]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c43ea098-533b-4fa2-8c33-b5e4d347a117 tempest-GroupSnapshotsV319Test-1906589605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e.476ef511-34f9-4938-95c5-7a3cc96dde6b" returned: 0 in 0.902s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:59 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c43ea098-533b-4fa2-8c33-b5e4d347a117 tempest-GroupSnapshotsV319Test-1906589605 None] Lock "cinder-quobyte-476ef511-34f9-4938-95c5-7a3cc96dde6b" released by "_delete_snapshot" :: held 3.436s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:26:59 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c43ea098-533b-4fa2-8c33-b5e4d347a117 tempest-GroupSnapshotsV319Test-1906589605 None] Lock "cinder-quobyte-bbd77634-f83f-4f11-af2f-1b11770b812e" released by "delete_snapshot" :: held 3.457s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:26:59 devstack cinder-volume[82102]: WARNING cinder.quota [None req-c43ea098-533b-4fa2-8c33-b5e4d347a117 tempest-GroupSnapshotsV319Test-1906589605 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-935291045 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-935291045, it is now deprecated. Please use the default quota class for default quota.
Apr 02 10:26:59 devstack cinder-volume[82102]: WARNING cinder.quota [None req-c43ea098-533b-4fa2-8c33-b5e4d347a117 tempest-GroupSnapshotsV319Test-1906589605 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-935291045 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-935291045, it is now deprecated. Please use the default quota class for default quota.
Apr 02 10:26:59 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-c43ea098-533b-4fa2-8c33-b5e4d347a117 tempest-GroupSnapshotsV319Test-1906589605 None] Created reservations ['427e0b7d-929f-454c-9dd6-027b2d50b645', '7c3f1438-50dd-47bd-a9c1-a4f6f4e9c776', 'feea5d28-da2d-4757-8969-234ca18a3ca1', 'fccde13c-55ee-42e3-b61d-22738bd55e63'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:26:59 devstack sudo[85184]: pam_unix(sudo:session): session closed for user root
Apr 02 10:26:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_vpo9h_tsdevstack@QuobyteHD" returned: 0 in 1.126s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:26:59 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] 100d2cbf-7145-49cd-863b-c1e137045ce3 was qcow2, converting to raw {{(pid=82102) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 02 10:26:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_vpo9h_tsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-feb47614-2a9a-42af-8173-d33836766d3b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:26:59 devstack sudo[85193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_vpo9h_tsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-feb47614-2a9a-42af-8173-d33836766d3b
Apr 02 10:26:59 devstack sudo[85193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:26:59 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-c43ea098-533b-4fa2-8c33-b5e4d347a117 tempest-GroupSnapshotsV319Test-1906589605 None] group_snapshot 7d911366-b03c-45eb-98e6-fedc0af0ce4d: deleted successfully
Apr 02 10:27:00 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f94cde8-48a1-416e-a1e1-31a355ae8810 tempest-ServersNegativeTestJSON-1173775544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:27:00 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f94cde8-48a1-416e-a1e1-31a355ae8810 tempest-ServersNegativeTestJSON-1173775544 None] Flow 'volume_create_manager' (310cd49e-040f-47de-bea5-7105467119a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:27:00 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f94cde8-48a1-416e-a1e1-31a355ae8810 tempest-ServersNegativeTestJSON-1173775544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4548ff75-cdac-4b41-adff-c3d0e80332c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:00 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f94cde8-48a1-416e-a1e1-31a355ae8810 tempest-ServersNegativeTestJSON-1173775544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4548ff75-cdac-4b41-adff-c3d0e80332c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1756145479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f3f2ac3-0b5b-4b72-9b20-0069d145aee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='213ef1c1e55c47b1a5b8c249a3bad84f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:27:00Z,use_quota=True,user_id='269012757feb4e0b85addd147192d42d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:00 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f94cde8-48a1-416e-a1e1-31a355ae8810 tempest-ServersNegativeTestJSON-1173775544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e6cad3a-0f63-4ea9-b7b7-7a2e16548ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:00 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f94cde8-48a1-416e-a1e1-31a355ae8810 tempest-ServersNegativeTestJSON-1173775544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e6cad3a-0f63-4ea9-b7b7-7a2e16548ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:00 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f94cde8-48a1-416e-a1e1-31a355ae8810 tempest-ServersNegativeTestJSON-1173775544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b26bae-8982-412f-a6aa-301b4cff5069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:00 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f94cde8-48a1-416e-a1e1-31a355ae8810 tempest-ServersNegativeTestJSON-1173775544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b26bae-8982-412f-a6aa-301b4cff5069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f3f2ac3-0b5b-4b72-9b20-0069d145aee8', 'volume_name': 'volume-6f3f2ac3-0b5b-4b72-9b20-0069d145aee8', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:00 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f94cde8-48a1-416e-a1e1-31a355ae8810 tempest-ServersNegativeTestJSON-1173775544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd7a9c72-514c-4a1d-a6a4-b51ee7c92c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:00 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f94cde8-48a1-416e-a1e1-31a355ae8810 tempest-ServersNegativeTestJSON-1173775544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd7a9c72-514c-4a1d-a6a4-b51ee7c92c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:00 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f94cde8-48a1-416e-a1e1-31a355ae8810 tempest-ServersNegativeTestJSON-1173775544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd0a8f16-98bb-442b-8bad-2e5e238c29ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:00 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-8f94cde8-48a1-416e-a1e1-31a355ae8810 tempest-ServersNegativeTestJSON-1173775544 None] Volume 6f3f2ac3-0b5b-4b72-9b20-0069d145aee8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f3f2ac3-0b5b-4b72-9b20-0069d145aee8', 'volume_size': 1}
Apr 02 10:27:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8f94cde8-48a1-416e-a1e1-31a355ae8810 tempest-ServersNegativeTestJSON-1173775544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:27:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8f94cde8-48a1-416e-a1e1-31a355ae8810 tempest-ServersNegativeTestJSON-1173775544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:27:00 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8f94cde8-48a1-416e-a1e1-31a355ae8810 tempest-ServersNegativeTestJSON-1173775544 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1756145479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f3f2ac3-0b5b-4b72-9b20-0069d145aee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='213ef1c1e55c47b1a5b8c249a3bad84f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:27:00Z,use_quota=True,user_id='269012757feb4e0b85addd147192d42d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:27:00 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-8f94cde8-48a1-416e-a1e1-31a355ae8810 tempest-ServersNegativeTestJSON-1173775544 None] Creating volume 6f3f2ac3-0b5b-4b72-9b20-0069d145aee8 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:27:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8f94cde8-48a1-416e-a1e1-31a355ae8810 tempest-ServersNegativeTestJSON-1173775544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:27:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8f94cde8-48a1-416e-a1e1-31a355ae8810 tempest-ServersNegativeTestJSON-1173775544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:27:00 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8f94cde8-48a1-416e-a1e1-31a355ae8810 tempest-ServersNegativeTestJSON-1173775544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:27:00 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8f94cde8-48a1-416e-a1e1-31a355ae8810 tempest-ServersNegativeTestJSON-1173775544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:27:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8f94cde8-48a1-416e-a1e1-31a355ae8810 tempest-ServersNegativeTestJSON-1173775544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:27:00 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8f94cde8-48a1-416e-a1e1-31a355ae8810 tempest-ServersNegativeTestJSON-1173775544 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:27:00 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-8f94cde8-48a1-416e-a1e1-31a355ae8810 tempest-ServersNegativeTestJSON-1173775544 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:27:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8f94cde8-48a1-416e-a1e1-31a355ae8810 tempest-ServersNegativeTestJSON-1173775544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6f3f2ac3-0b5b-4b72-9b20-0069d145aee8 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:00 devstack sudo[85200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6f3f2ac3-0b5b-4b72-9b20-0069d145aee8 1073741824
Apr 02 10:27:00 devstack sudo[85200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:00 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-49a2244e-0264-4fea-ac63-56c4170a9041 tempest-GroupSnapshotsV319Test-1906589605 None] Acquiring lock "cinder-quobyte-bbd77634-f83f-4f11-af2f-1b11770b812e" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:27:00 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-49a2244e-0264-4fea-ac63-56c4170a9041 tempest-GroupSnapshotsV319Test-1906589605 None] Lock "cinder-quobyte-bbd77634-f83f-4f11-af2f-1b11770b812e" acquired by "delete_volume" :: waited 0.014s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:27:00 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0664202-112e-4454-abe3-d07ca8664a55]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-49a2244e-0264-4fea-ac63-56c4170a9041 tempest-GroupSnapshotsV319Test-1906589605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:01 devstack sudo[85202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e
Apr 02 10:27:01 devstack sudo[85202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:01 devstack sudo[85193]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_vpo9h_tsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-feb47614-2a9a-42af-8173-d33836766d3b" returned: 0 in 1.529s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:01 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_vpo9h_tsdevstack@QuobyteHD, size 112.00 MB, duration 1.53 sec, destination /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-feb47614-2a9a-42af-8173-d33836766d3b {{(pid=82102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 02 10:27:01 devstack cinder-volume[82102]: INFO cinder.image.image_utils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Converted 112.00 MB image at 73.19 MB/s
Apr 02 10:27:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-feb47614-2a9a-42af-8173-d33836766d3b 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:01 devstack sudo[85208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-feb47614-2a9a-42af-8173-d33836766d3b 1G
Apr 02 10:27:01 devstack sudo[85208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:01 devstack sudo[85200]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8f94cde8-48a1-416e-a1e1-31a355ae8810 tempest-ServersNegativeTestJSON-1173775544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6f3f2ac3-0b5b-4b72-9b20-0069d145aee8 1073741824" returned: 0 in 0.857s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8f94cde8-48a1-416e-a1e1-31a355ae8810 tempest-ServersNegativeTestJSON-1173775544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6f3f2ac3-0b5b-4b72-9b20-0069d145aee8 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:01 devstack sudo[85210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6f3f2ac3-0b5b-4b72-9b20-0069d145aee8
Apr 02 10:27:01 devstack sudo[85210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:01 devstack sudo[85208]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-feb47614-2a9a-42af-8173-d33836766d3b 1G" returned: 0 in 0.657s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:01 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d168f890-8a99-4357-93de-592ca2cdcdde]: (4, 'raw') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-feb47614-2a9a-42af-8173-d33836766d3b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:01 devstack sudo[85202]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-49a2244e-0264-4fea-ac63-56c4170a9041 tempest-GroupSnapshotsV319Test-1906589605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e" returned: 0 in 0.941s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-49a2244e-0264-4fea-ac63-56c4170a9041 tempest-GroupSnapshotsV319Test-1906589605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:01 devstack sudo[85219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e
Apr 02 10:27:01 devstack sudo[85219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:01 devstack sudo[85218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-feb47614-2a9a-42af-8173-d33836766d3b
Apr 02 10:27:01 devstack sudo[85218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:02 devstack sudo[85210]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8f94cde8-48a1-416e-a1e1-31a355ae8810 tempest-ServersNegativeTestJSON-1173775544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6f3f2ac3-0b5b-4b72-9b20-0069d145aee8" returned: 0 in 0.778s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:02 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8f94cde8-48a1-416e-a1e1-31a355ae8810 tempest-ServersNegativeTestJSON-1173775544 None] <== create_volume: return (1737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:27:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8f94cde8-48a1-416e-a1e1-31a355ae8810 tempest-ServersNegativeTestJSON-1173775544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:27:02 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f94cde8-48a1-416e-a1e1-31a355ae8810 tempest-ServersNegativeTestJSON-1173775544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd0a8f16-98bb-442b-8bad-2e5e238c29ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f3f2ac3-0b5b-4b72-9b20-0069d145aee8', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:02 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f94cde8-48a1-416e-a1e1-31a355ae8810 tempest-ServersNegativeTestJSON-1173775544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6059ef50-b62e-43e9-b7fd-c9b44e9a44df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:02 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-8f94cde8-48a1-416e-a1e1-31a355ae8810 tempest-ServersNegativeTestJSON-1173775544 None] Volume volume-6f3f2ac3-0b5b-4b72-9b20-0069d145aee8 (6f3f2ac3-0b5b-4b72-9b20-0069d145aee8): created successfully
Apr 02 10:27:02 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f94cde8-48a1-416e-a1e1-31a355ae8810 tempest-ServersNegativeTestJSON-1173775544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6059ef50-b62e-43e9-b7fd-c9b44e9a44df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:02 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f94cde8-48a1-416e-a1e1-31a355ae8810 tempest-ServersNegativeTestJSON-1173775544 None] Flow 'volume_create_manager' (310cd49e-040f-47de-bea5-7105467119a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:27:02 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-8f94cde8-48a1-416e-a1e1-31a355ae8810 tempest-ServersNegativeTestJSON-1173775544 None] Created volume successfully.
Apr 02 10:27:02 devstack sudo[85218]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-feb47614-2a9a-42af-8173-d33836766d3b" returned: 0 in 0.772s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-feb47614-2a9a-42af-8173-d33836766d3b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:02 devstack sudo[85219]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-49a2244e-0264-4fea-ac63-56c4170a9041 tempest-GroupSnapshotsV319Test-1906589605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-bbd77634-f83f-4f11-af2f-1b11770b812e" returned: 0 in 0.852s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:02 devstack sudo[85227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-feb47614-2a9a-42af-8173-d33836766d3b
Apr 02 10:27:02 devstack sudo[85227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:02 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-49a2244e-0264-4fea-ac63-56c4170a9041 tempest-GroupSnapshotsV319Test-1906589605 None] Lock "cinder-quobyte-bbd77634-f83f-4f11-af2f-1b11770b812e" released by "delete_volume" :: held 1.873s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:27:02 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-49a2244e-0264-4fea-ac63-56c4170a9041 tempest-GroupSnapshotsV319Test-1906589605 None] Created reservations ['3bb0c0f6-64ec-4c2c-997b-e6b6935a2a3d'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:27:02 devstack cinder-volume[82102]: WARNING cinder.quota [None req-49a2244e-0264-4fea-ac63-56c4170a9041 tempest-GroupSnapshotsV319Test-1906589605 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-935291045 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-935291045, it is now deprecated. Please use the default quota class for default quota.
Apr 02 10:27:02 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-49a2244e-0264-4fea-ac63-56c4170a9041 tempest-GroupSnapshotsV319Test-1906589605 None] Created reservations ['5fe497dd-ba94-4bc3-8e4c-340509076241', 'ae7ec1a8-4ec6-4555-86a5-91534c31dcfa', 'c5661070-390a-488e-9036-60a5b42683e6', '562f0e5e-33d1-4fd0-b6d9-f8dd4830d865'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:27:03 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5bec1b9e-1a75-4192-93dc-1e28349cb359 tempest-ServersNegativeTestJSON-1173775544 None] Acquiring lock "cinder-6f3f2ac3-0b5b-4b72-9b20-0069d145aee8-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:27:03 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5bec1b9e-1a75-4192-93dc-1e28349cb359 tempest-ServersNegativeTestJSON-1173775544 None] Lock "cinder-6f3f2ac3-0b5b-4b72-9b20-0069d145aee8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:27:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-49a2244e-0264-4fea-ac63-56c4170a9041 tempest-GroupSnapshotsV319Test-1906589605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:27:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-49a2244e-0264-4fea-ac63-56c4170a9041 tempest-GroupSnapshotsV319Test-1906589605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:27:03 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-49a2244e-0264-4fea-ac63-56c4170a9041 tempest-GroupSnapshotsV319Test-1906589605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:27:03 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-49a2244e-0264-4fea-ac63-56c4170a9041 tempest-GroupSnapshotsV319Test-1906589605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:27:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-49a2244e-0264-4fea-ac63-56c4170a9041 tempest-GroupSnapshotsV319Test-1906589605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:27:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-49a2244e-0264-4fea-ac63-56c4170a9041 tempest-GroupSnapshotsV319Test-1906589605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:03 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5bec1b9e-1a75-4192-93dc-1e28349cb359 tempest-ServersNegativeTestJSON-1173775544 None] Acquiring lock "cinder-quobyte-6f3f2ac3-0b5b-4b72-9b20-0069d145aee8" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:27:03 devstack sudo[85240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:27:03 devstack sudo[85240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:03 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5bec1b9e-1a75-4192-93dc-1e28349cb359 tempest-ServersNegativeTestJSON-1173775544 None] Lock "cinder-quobyte-6f3f2ac3-0b5b-4b72-9b20-0069d145aee8" acquired by "delete_volume" :: waited 0.020s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:27:03 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c03b87-9a7f-4a64-8fc1-e44c1d6021c4]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5bec1b9e-1a75-4192-93dc-1e28349cb359 tempest-ServersNegativeTestJSON-1173775544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6f3f2ac3-0b5b-4b72-9b20-0069d145aee8 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:03 devstack sudo[85247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6f3f2ac3-0b5b-4b72-9b20-0069d145aee8
Apr 02 10:27:03 devstack sudo[85247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:03 devstack sudo[85227]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-feb47614-2a9a-42af-8173-d33836766d3b" returned: 1 in 1.336s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-feb47614-2a9a-42af-8173-d33836766d3b' failed. Not Retrying. {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 02 10:27:03 devstack cinder-volume[82102]: DEBUG cinder.volume.volume_utils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Downloaded image 100d2cbf-7145-49cd-863b-c1e137045ce3 ((None, [{'url': 'file:///opt/stack/data/glance/images/100d2cbf-7145-49cd-863b-c1e137045ce3', 'metadata': {}}])) to volume feb47614-2a9a-42af-8173-d33836766d3b successfully. {{(pid=82102) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 02 10:27:03 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Temporary image 100d2cbf-7145-49cd-863b-c1e137045ce3 for user 0132f8ec35b84e569dccee886888777e is deleted. {{(pid=82102) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 02 10:27:03 devstack cinder-volume[82102]: DEBUG cinder.volume.volume_utils [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Marking volume feb47614-2a9a-42af-8173-d33836766d3b as bootable. {{(pid=82102) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 02 10:27:03 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Copying metadata from image 100d2cbf-7145-49cd-863b-c1e137045ce3 to feb47614-2a9a-42af-8173-d33836766d3b. {{(pid=82102) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 02 10:27:03 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Creating volume glance metadata for volume feb47614-2a9a-42af-8173-d33836766d3b backed by image 100d2cbf-7145-49cd-863b-c1e137045ce3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '100d2cbf-7145-49cd-863b-c1e137045ce3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82102) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 02 10:27:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (178bfbb2-a8c0-457a-a7d7-e0c5f6ecaf61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feb47614-2a9a-42af-8173-d33836766d3b', 'volume_size': 1, 'image_id': '100d2cbf-7145-49cd-863b-c1e137045ce3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/100d2cbf-7145-49cd-863b-c1e137045ce3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e7bc1c1d4b5544979a3d9a5428cd3e5d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '100d2cbf-7145-49cd-863b-c1e137045ce3', 'created_at': datetime.datetime(2026, 4, 2, 8, 20, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 8, 20, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/100d2cbf-7145-49cd-863b-c1e137045ce3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f636de3fdc0>}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d43b68a7-f3b5-4c75-812d-cadd9d35f583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:04 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Volume volume-feb47614-2a9a-42af-8173-d33836766d3b (feb47614-2a9a-42af-8173-d33836766d3b): created successfully
Apr 02 10:27:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d43b68a7-f3b5-4c75-812d-cadd9d35f583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Flow 'volume_create_manager' (2727643d-4696-4040-ab6d-ce7af1e42864) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:27:04 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-5ca63f24-a670-4c5f-8ddd-92ca0e48cb57 tempest-VolumesImageMetadata-227877871 None] Created volume successfully.
Apr 02 10:27:04 devstack sudo[85240]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-49a2244e-0264-4fea-ac63-56c4170a9041 tempest-GroupSnapshotsV319Test-1906589605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 1.284s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:04 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-49a2244e-0264-4fea-ac63-56c4170a9041 tempest-GroupSnapshotsV319Test-1906589605 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:27:04 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-49a2244e-0264-4fea-ac63-56c4170a9041 tempest-GroupSnapshotsV319Test-1906589605 None] Delete group completed successfully.
Apr 02 10:27:04 devstack sudo[85247]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5bec1b9e-1a75-4192-93dc-1e28349cb359 tempest-ServersNegativeTestJSON-1173775544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6f3f2ac3-0b5b-4b72-9b20-0069d145aee8" returned: 0 in 1.330s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5bec1b9e-1a75-4192-93dc-1e28349cb359 tempest-ServersNegativeTestJSON-1173775544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6f3f2ac3-0b5b-4b72-9b20-0069d145aee8 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:04 devstack sudo[85267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6f3f2ac3-0b5b-4b72-9b20-0069d145aee8
Apr 02 10:27:04 devstack sudo[85267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:05 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-067633d9-947b-441b-a6a1-539e31858f5c tempest-VolumesImageMetadata-227877871 None] Acquiring lock "cinder-feb47614-2a9a-42af-8173-d33836766d3b-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:27:05 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-067633d9-947b-441b-a6a1-539e31858f5c tempest-VolumesImageMetadata-227877871 None] Lock "cinder-feb47614-2a9a-42af-8173-d33836766d3b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:27:05 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-067633d9-947b-441b-a6a1-539e31858f5c tempest-VolumesImageMetadata-227877871 None] Acquiring lock "cinder-quobyte-feb47614-2a9a-42af-8173-d33836766d3b" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:27:05 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-067633d9-947b-441b-a6a1-539e31858f5c tempest-VolumesImageMetadata-227877871 None] Lock "cinder-quobyte-feb47614-2a9a-42af-8173-d33836766d3b" acquired by "delete_volume" :: waited 0.013s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:27:05 devstack sudo[85267]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5bec1b9e-1a75-4192-93dc-1e28349cb359 tempest-ServersNegativeTestJSON-1173775544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6f3f2ac3-0b5b-4b72-9b20-0069d145aee8" returned: 0 in 0.872s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:05 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb99f59-273f-4bbf-a32a-048e7e13017b]: (4, 'raw') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-067633d9-947b-441b-a6a1-539e31858f5c tempest-VolumesImageMetadata-227877871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-feb47614-2a9a-42af-8173-d33836766d3b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:05 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5bec1b9e-1a75-4192-93dc-1e28349cb359 tempest-ServersNegativeTestJSON-1173775544 None] Lock "cinder-quobyte-6f3f2ac3-0b5b-4b72-9b20-0069d145aee8" released by "delete_volume" :: held 2.286s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:27:05 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-5bec1b9e-1a75-4192-93dc-1e28349cb359 tempest-ServersNegativeTestJSON-1173775544 None] Created reservations ['845c0199-1591-49fe-a5e7-3e5a65dd09f2', 'aaaf0b6c-63eb-43a8-938f-f2693c3895ec', 'bfbb56ee-3bfb-43d4-9458-f6d3c226415d', 'ffd918d6-c40a-4ec9-93d4-1e5aece04401'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:27:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5bec1b9e-1a75-4192-93dc-1e28349cb359 tempest-ServersNegativeTestJSON-1173775544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:27:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5bec1b9e-1a75-4192-93dc-1e28349cb359 tempest-ServersNegativeTestJSON-1173775544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:27:05 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5bec1b9e-1a75-4192-93dc-1e28349cb359 tempest-ServersNegativeTestJSON-1173775544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:27:05 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5bec1b9e-1a75-4192-93dc-1e28349cb359 tempest-ServersNegativeTestJSON-1173775544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:27:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5bec1b9e-1a75-4192-93dc-1e28349cb359 tempest-ServersNegativeTestJSON-1173775544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:27:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5bec1b9e-1a75-4192-93dc-1e28349cb359 tempest-ServersNegativeTestJSON-1173775544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:05 devstack sudo[85270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-feb47614-2a9a-42af-8173-d33836766d3b
Apr 02 10:27:05 devstack sudo[85270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:05 devstack sudo[85271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:27:05 devstack sudo[85271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:06 devstack sudo[85270]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-067633d9-947b-441b-a6a1-539e31858f5c tempest-VolumesImageMetadata-227877871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-feb47614-2a9a-42af-8173-d33836766d3b" returned: 0 in 0.819s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-067633d9-947b-441b-a6a1-539e31858f5c tempest-VolumesImageMetadata-227877871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-feb47614-2a9a-42af-8173-d33836766d3b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:06 devstack sudo[85277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-feb47614-2a9a-42af-8173-d33836766d3b
Apr 02 10:27:06 devstack sudo[85277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:06 devstack sudo[85271]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5bec1b9e-1a75-4192-93dc-1e28349cb359 tempest-ServersNegativeTestJSON-1173775544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.821s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:06 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-5bec1b9e-1a75-4192-93dc-1e28349cb359 tempest-ServersNegativeTestJSON-1173775544 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:27:06 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-5bec1b9e-1a75-4192-93dc-1e28349cb359 tempest-ServersNegativeTestJSON-1173775544 None] Deleted volume successfully.
Apr 02 10:27:06 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5bec1b9e-1a75-4192-93dc-1e28349cb359 tempest-ServersNegativeTestJSON-1173775544 None] Lock "cinder-6f3f2ac3-0b5b-4b72-9b20-0069d145aee8-delete_volume" released by "delete_volume" :: held 3.381s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:27:06 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-583825db-1d71-4253-a7b2-e23d2264340d tempest-ServersNegativeTestJSON-1173775544 None] Acquiring lock "cinder-e3f8d17d-40f6-41c8-a52c-598467bcfa6b-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:27:06 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-583825db-1d71-4253-a7b2-e23d2264340d tempest-ServersNegativeTestJSON-1173775544 None] Lock "cinder-e3f8d17d-40f6-41c8-a52c-598467bcfa6b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:27:06 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-583825db-1d71-4253-a7b2-e23d2264340d tempest-ServersNegativeTestJSON-1173775544 None] Acquiring lock "cinder-quobyte-e3f8d17d-40f6-41c8-a52c-598467bcfa6b" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:27:06 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-583825db-1d71-4253-a7b2-e23d2264340d tempest-ServersNegativeTestJSON-1173775544 None] Lock "cinder-quobyte-e3f8d17d-40f6-41c8-a52c-598467bcfa6b" acquired by "delete_volume" :: waited 0.019s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:27:06 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb329df-0b84-41d3-9d27-7102430aa2bb]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-583825db-1d71-4253-a7b2-e23d2264340d tempest-ServersNegativeTestJSON-1173775544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3f8d17d-40f6-41c8-a52c-598467bcfa6b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:06 devstack sudo[85279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3f8d17d-40f6-41c8-a52c-598467bcfa6b
Apr 02 10:27:06 devstack sudo[85279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:07 devstack sudo[85277]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-067633d9-947b-441b-a6a1-539e31858f5c tempest-VolumesImageMetadata-227877871 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-feb47614-2a9a-42af-8173-d33836766d3b" returned: 1 in 0.850s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-067633d9-947b-441b-a6a1-539e31858f5c tempest-VolumesImageMetadata-227877871 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-feb47614-2a9a-42af-8173-d33836766d3b' failed. Not Retrying. {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 02 10:27:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-067633d9-947b-441b-a6a1-539e31858f5c tempest-VolumesImageMetadata-227877871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-feb47614-2a9a-42af-8173-d33836766d3b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:07 devstack sudo[85284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-feb47614-2a9a-42af-8173-d33836766d3b
Apr 02 10:27:07 devstack sudo[85284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:07 devstack sudo[85279]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-583825db-1d71-4253-a7b2-e23d2264340d tempest-ServersNegativeTestJSON-1173775544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3f8d17d-40f6-41c8-a52c-598467bcfa6b" returned: 0 in 0.640s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-583825db-1d71-4253-a7b2-e23d2264340d tempest-ServersNegativeTestJSON-1173775544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3f8d17d-40f6-41c8-a52c-598467bcfa6b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:07 devstack sudo[85289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3f8d17d-40f6-41c8-a52c-598467bcfa6b
Apr 02 10:27:07 devstack sudo[85289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:07 devstack sudo[85284]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-067633d9-947b-441b-a6a1-539e31858f5c tempest-VolumesImageMetadata-227877871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-feb47614-2a9a-42af-8173-d33836766d3b" returned: 0 in 0.558s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:07 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-067633d9-947b-441b-a6a1-539e31858f5c tempest-VolumesImageMetadata-227877871 None] Lock "cinder-quobyte-feb47614-2a9a-42af-8173-d33836766d3b" released by "delete_volume" :: held 2.296s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:27:07 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-067633d9-947b-441b-a6a1-539e31858f5c tempest-VolumesImageMetadata-227877871 None] Created reservations ['8b160d89-1349-42d1-8bc0-e2489523128c', 'a1aa10a5-cd4c-4897-8059-2c5a7bbbb0b6', '1fc83830-7017-4f09-a12f-5d8b21f3cd39', '621f601f-3ac2-4e8f-baf2-9b07da28bccf'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:27:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-067633d9-947b-441b-a6a1-539e31858f5c tempest-VolumesImageMetadata-227877871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:27:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-067633d9-947b-441b-a6a1-539e31858f5c tempest-VolumesImageMetadata-227877871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:27:07 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-067633d9-947b-441b-a6a1-539e31858f5c tempest-VolumesImageMetadata-227877871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:27:07 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-067633d9-947b-441b-a6a1-539e31858f5c tempest-VolumesImageMetadata-227877871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:27:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-067633d9-947b-441b-a6a1-539e31858f5c tempest-VolumesImageMetadata-227877871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:27:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-067633d9-947b-441b-a6a1-539e31858f5c tempest-VolumesImageMetadata-227877871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:07 devstack sudo[85293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:27:07 devstack sudo[85293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:07 devstack sudo[85289]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-583825db-1d71-4253-a7b2-e23d2264340d tempest-ServersNegativeTestJSON-1173775544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3f8d17d-40f6-41c8-a52c-598467bcfa6b" returned: 0 in 0.668s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:07 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-583825db-1d71-4253-a7b2-e23d2264340d tempest-ServersNegativeTestJSON-1173775544 None] Lock "cinder-quobyte-e3f8d17d-40f6-41c8-a52c-598467bcfa6b" released by "delete_volume" :: held 1.364s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:27:07 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-583825db-1d71-4253-a7b2-e23d2264340d tempest-ServersNegativeTestJSON-1173775544 None] Created reservations ['5e2b8c3e-f766-4001-918b-6da14307c7ae', '2066ed08-035e-44ff-a32b-ae7eb580e5a7', '2ca9f567-7a28-4ead-a62d-4dbe522f8481', 'c21d7764-c97a-4cb6-a261-f21252ae1271'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:27:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-583825db-1d71-4253-a7b2-e23d2264340d tempest-ServersNegativeTestJSON-1173775544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:27:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-583825db-1d71-4253-a7b2-e23d2264340d tempest-ServersNegativeTestJSON-1173775544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:27:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-583825db-1d71-4253-a7b2-e23d2264340d tempest-ServersNegativeTestJSON-1173775544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:27:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-583825db-1d71-4253-a7b2-e23d2264340d tempest-ServersNegativeTestJSON-1173775544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:27:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-583825db-1d71-4253-a7b2-e23d2264340d tempest-ServersNegativeTestJSON-1173775544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:27:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-583825db-1d71-4253-a7b2-e23d2264340d tempest-ServersNegativeTestJSON-1173775544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:08 devstack sudo[85295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:27:08 devstack sudo[85295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:08 devstack sudo[85293]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-067633d9-947b-441b-a6a1-539e31858f5c tempest-VolumesImageMetadata-227877871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.679s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:08 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-067633d9-947b-441b-a6a1-539e31858f5c tempest-VolumesImageMetadata-227877871 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:27:08 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-067633d9-947b-441b-a6a1-539e31858f5c tempest-VolumesImageMetadata-227877871 None] Deleted volume successfully.
Apr 02 10:27:08 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-067633d9-947b-441b-a6a1-539e31858f5c tempest-VolumesImageMetadata-227877871 None] Lock "cinder-feb47614-2a9a-42af-8173-d33836766d3b-delete_volume" released by "delete_volume" :: held 3.279s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:27:08 devstack cinder-volume[82102]: DEBUG oslo_service.periodic_task [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 02 10:27:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:27:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:27:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:27:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:27:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:27:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:08 devstack sudo[85299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:27:08 devstack sudo[85299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:08 devstack sudo[85295]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-583825db-1d71-4253-a7b2-e23d2264340d tempest-ServersNegativeTestJSON-1173775544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.678s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:08 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-583825db-1d71-4253-a7b2-e23d2264340d tempest-ServersNegativeTestJSON-1173775544 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:27:08 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-583825db-1d71-4253-a7b2-e23d2264340d tempest-ServersNegativeTestJSON-1173775544 None] Deleted volume successfully.
Apr 02 10:27:08 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-583825db-1d71-4253-a7b2-e23d2264340d tempest-ServersNegativeTestJSON-1173775544 None] Lock "cinder-e3f8d17d-40f6-41c8-a52c-598467bcfa6b-delete_volume" released by "delete_volume" :: held 2.289s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:27:09 devstack sudo[85299]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.735s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:09 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:27:12 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-57e8fec3-a5db-47e3-a8b6-7a4e2f793e33 tempest-SnapshotMetadataTestJSON-2027062647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:27:12 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-57e8fec3-a5db-47e3-a8b6-7a4e2f793e33 tempest-SnapshotMetadataTestJSON-2027062647 None] Flow 'volume_create_manager' (2d9cf9fd-dba7-4e25-a56a-594a8bbcc3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:27:12 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-57e8fec3-a5db-47e3-a8b6-7a4e2f793e33 tempest-SnapshotMetadataTestJSON-2027062647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37950848-47a5-4a78-9389-10796e1739d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:12 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-57e8fec3-a5db-47e3-a8b6-7a4e2f793e33 tempest-SnapshotMetadataTestJSON-2027062647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37950848-47a5-4a78-9389-10796e1739d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1602705329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73db9625-74c0-4c83-8172-efc9f5d7e505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eba8ac5e70944eab020d6dc8ceabb00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:27:12Z,use_quota=True,user_id='1e4b38df84a0478dabbdc67aedf595d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:12 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-57e8fec3-a5db-47e3-a8b6-7a4e2f793e33 tempest-SnapshotMetadataTestJSON-2027062647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acc63a9d-1021-44da-9bf7-934c8b1d9fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:12 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-57e8fec3-a5db-47e3-a8b6-7a4e2f793e33 tempest-SnapshotMetadataTestJSON-2027062647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acc63a9d-1021-44da-9bf7-934c8b1d9fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:12 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-57e8fec3-a5db-47e3-a8b6-7a4e2f793e33 tempest-SnapshotMetadataTestJSON-2027062647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee88f14f-9d23-4625-97bf-292adea06f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:12 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-57e8fec3-a5db-47e3-a8b6-7a4e2f793e33 tempest-SnapshotMetadataTestJSON-2027062647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee88f14f-9d23-4625-97bf-292adea06f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73db9625-74c0-4c83-8172-efc9f5d7e505', 'volume_name': 'volume-73db9625-74c0-4c83-8172-efc9f5d7e505', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:12 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-57e8fec3-a5db-47e3-a8b6-7a4e2f793e33 tempest-SnapshotMetadataTestJSON-2027062647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (018958b8-88e7-4eb1-be4e-c9c5a31c35e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:12 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-57e8fec3-a5db-47e3-a8b6-7a4e2f793e33 tempest-SnapshotMetadataTestJSON-2027062647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (018958b8-88e7-4eb1-be4e-c9c5a31c35e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:12 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-57e8fec3-a5db-47e3-a8b6-7a4e2f793e33 tempest-SnapshotMetadataTestJSON-2027062647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97841f14-c9ee-465c-b119-92b19c9064d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:12 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-57e8fec3-a5db-47e3-a8b6-7a4e2f793e33 tempest-SnapshotMetadataTestJSON-2027062647 None] Volume 73db9625-74c0-4c83-8172-efc9f5d7e505: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73db9625-74c0-4c83-8172-efc9f5d7e505', 'volume_size': 1}
Apr 02 10:27:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-57e8fec3-a5db-47e3-a8b6-7a4e2f793e33 tempest-SnapshotMetadataTestJSON-2027062647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:27:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-57e8fec3-a5db-47e3-a8b6-7a4e2f793e33 tempest-SnapshotMetadataTestJSON-2027062647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:27:12 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-57e8fec3-a5db-47e3-a8b6-7a4e2f793e33 tempest-SnapshotMetadataTestJSON-2027062647 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1602705329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73db9625-74c0-4c83-8172-efc9f5d7e505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eba8ac5e70944eab020d6dc8ceabb00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:27:12Z,use_quota=True,user_id='1e4b38df84a0478dabbdc67aedf595d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:27:12 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-57e8fec3-a5db-47e3-a8b6-7a4e2f793e33 tempest-SnapshotMetadataTestJSON-2027062647 None] Creating volume 73db9625-74c0-4c83-8172-efc9f5d7e505 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:27:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-57e8fec3-a5db-47e3-a8b6-7a4e2f793e33 tempest-SnapshotMetadataTestJSON-2027062647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:27:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-57e8fec3-a5db-47e3-a8b6-7a4e2f793e33 tempest-SnapshotMetadataTestJSON-2027062647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:27:12 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-57e8fec3-a5db-47e3-a8b6-7a4e2f793e33 tempest-SnapshotMetadataTestJSON-2027062647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:27:12 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-57e8fec3-a5db-47e3-a8b6-7a4e2f793e33 tempest-SnapshotMetadataTestJSON-2027062647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:27:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-57e8fec3-a5db-47e3-a8b6-7a4e2f793e33 tempest-SnapshotMetadataTestJSON-2027062647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:27:12 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-57e8fec3-a5db-47e3-a8b6-7a4e2f793e33 tempest-SnapshotMetadataTestJSON-2027062647 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:27:12 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-57e8fec3-a5db-47e3-a8b6-7a4e2f793e33 tempest-SnapshotMetadataTestJSON-2027062647 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:27:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-57e8fec3-a5db-47e3-a8b6-7a4e2f793e33 tempest-SnapshotMetadataTestJSON-2027062647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:12 devstack sudo[85344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505 1073741824
Apr 02 10:27:12 devstack sudo[85344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:13 devstack sudo[85344]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-57e8fec3-a5db-47e3-a8b6-7a4e2f793e33 tempest-SnapshotMetadataTestJSON-2027062647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505 1073741824" returned: 0 in 0.753s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-57e8fec3-a5db-47e3-a8b6-7a4e2f793e33 tempest-SnapshotMetadataTestJSON-2027062647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:13 devstack sudo[85350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505
Apr 02 10:27:13 devstack sudo[85350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:13 devstack sudo[85350]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-57e8fec3-a5db-47e3-a8b6-7a4e2f793e33 tempest-SnapshotMetadataTestJSON-2027062647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505" returned: 0 in 0.553s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:13 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-57e8fec3-a5db-47e3-a8b6-7a4e2f793e33 tempest-SnapshotMetadataTestJSON-2027062647 None] <== create_volume: return (1338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:27:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-57e8fec3-a5db-47e3-a8b6-7a4e2f793e33 tempest-SnapshotMetadataTestJSON-2027062647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.340s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:27:13 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-27ef3511-ec87-4115-8c2f-53344b68d1e3 tempest-GroupsV320Test-839734076 None] Group tempest-GroupsV320Test-Group-652978263: creating
Apr 02 10:27:13 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-57e8fec3-a5db-47e3-a8b6-7a4e2f793e33 tempest-SnapshotMetadataTestJSON-2027062647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97841f14-c9ee-465c-b119-92b19c9064d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73db9625-74c0-4c83-8172-efc9f5d7e505', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:13 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-57e8fec3-a5db-47e3-a8b6-7a4e2f793e33 tempest-SnapshotMetadataTestJSON-2027062647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f2f15f-6733-4247-b59f-cdb74b5c31e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:13 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-27ef3511-ec87-4115-8c2f-53344b68d1e3 tempest-GroupsV320Test-839734076 None] Group tempest-GroupsV320Test-Group-652978263: created successfully
Apr 02 10:27:13 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-57e8fec3-a5db-47e3-a8b6-7a4e2f793e33 tempest-SnapshotMetadataTestJSON-2027062647 None] Volume volume-73db9625-74c0-4c83-8172-efc9f5d7e505 (73db9625-74c0-4c83-8172-efc9f5d7e505): created successfully
Apr 02 10:27:13 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-57e8fec3-a5db-47e3-a8b6-7a4e2f793e33 tempest-SnapshotMetadataTestJSON-2027062647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f2f15f-6733-4247-b59f-cdb74b5c31e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:13 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-57e8fec3-a5db-47e3-a8b6-7a4e2f793e33 tempest-SnapshotMetadataTestJSON-2027062647 None] Flow 'volume_create_manager' (2d9cf9fd-dba7-4e25-a56a-594a8bbcc3ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:27:13 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-27ef3511-ec87-4115-8c2f-53344b68d1e3 tempest-GroupsV320Test-839734076 None] Create group completed successfully.
Apr 02 10:27:13 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-57e8fec3-a5db-47e3-a8b6-7a4e2f793e33 tempest-SnapshotMetadataTestJSON-2027062647 None] Created volume successfully.
Apr 02 10:27:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-09c6588a-619f-4548-b1c7-f2b799f38462 tempest-SnapshotMetadataTestJSON-2027062647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:27:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-09c6588a-619f-4548-b1c7-f2b799f38462 tempest-SnapshotMetadataTestJSON-2027062647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:27:14 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-09c6588a-619f-4548-b1c7-f2b799f38462 tempest-SnapshotMetadataTestJSON-2027062647 None] Creating offline snapshot 657c51c0-c6a8-4581-8431-591787c874b7 of volume 73db9625-74c0-4c83-8172-efc9f5d7e505 {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:27:14 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2a6558-850e-4b58-9c3c-b9f9ad2c1eb3]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-09c6588a-619f-4548-b1c7-f2b799f38462 tempest-SnapshotMetadataTestJSON-2027062647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:14 devstack sudo[85355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505
Apr 02 10:27:14 devstack sudo[85355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:15 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-3ed5b8c5-a1f2-4a99-a47c-4d342c5f6959 tempest-GroupsV320Test-839734076 None] Created reservations ['99029844-d732-4c0b-b601-fc70d0ad09fa'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:27:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3ed5b8c5-a1f2-4a99-a47c-4d342c5f6959 tempest-GroupsV320Test-839734076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:27:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3ed5b8c5-a1f2-4a99-a47c-4d342c5f6959 tempest-GroupsV320Test-839734076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:27:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3ed5b8c5-a1f2-4a99-a47c-4d342c5f6959 tempest-GroupsV320Test-839734076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:27:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3ed5b8c5-a1f2-4a99-a47c-4d342c5f6959 tempest-GroupsV320Test-839734076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:27:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3ed5b8c5-a1f2-4a99-a47c-4d342c5f6959 tempest-GroupsV320Test-839734076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:27:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3ed5b8c5-a1f2-4a99-a47c-4d342c5f6959 tempest-GroupsV320Test-839734076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:15 devstack sudo[85360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:27:15 devstack sudo[85360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:15 devstack sudo[85355]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-09c6588a-619f-4548-b1c7-f2b799f38462 tempest-SnapshotMetadataTestJSON-2027062647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505" returned: 0 in 1.005s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-09c6588a-619f-4548-b1c7-f2b799f38462 tempest-SnapshotMetadataTestJSON-2027062647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505.657c51c0-c6a8-4581-8431-591787c874b7 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:15 devstack sudo[85362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505.657c51c0-c6a8-4581-8431-591787c874b7 1G
Apr 02 10:27:15 devstack sudo[85362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:15 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:27:15 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Flow 'volume_create_manager' (e7ba0d43-7d4f-4d01-ae78-730498e7dd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:27:15 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea69c7a6-602d-454c-be11-96d8b3ac56c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:15 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea69c7a6-602d-454c-be11-96d8b3ac56c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:27:16Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34d6d557-e4bb-479b-9939-b32c59d38629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af18d76a2c2944d2b74a750e7dbbc2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:27:16Z,use_quota=True,user_id='5dc477cddeb04c1e9699cbbe7485783d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:15 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67cd6fb8-7fed-46fe-a441-3df038c66ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:15 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67cd6fb8-7fed-46fe-a441-3df038c66ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:15 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48bc896b-895a-4365-82fa-c882842314df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:15 devstack cinder-volume[82102]: DEBUG cinder.image.glance [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Creating Keystone auth plugin from conf {{(pid=82102) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 02 10:27:16 devstack sudo[85360]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3ed5b8c5-a1f2-4a99-a47c-4d342c5f6959 tempest-GroupsV320Test-839734076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.732s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:16 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-3ed5b8c5-a1f2-4a99-a47c-4d342c5f6959 tempest-GroupsV320Test-839734076 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:27:16 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-3ed5b8c5-a1f2-4a99-a47c-4d342c5f6959 tempest-GroupsV320Test-839734076 None] Delete group completed successfully.
Apr 02 10:27:16 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48bc896b-895a-4365-82fa-c882842314df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '34d6d557-e4bb-479b-9939-b32c59d38629', 'volume_name': 'volume-34d6d557-e4bb-479b-9939-b32c59d38629', 'volume_size': 1, 'image_id': '100d2cbf-7145-49cd-863b-c1e137045ce3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/100d2cbf-7145-49cd-863b-c1e137045ce3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e7bc1c1d4b5544979a3d9a5428cd3e5d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '100d2cbf-7145-49cd-863b-c1e137045ce3', 'created_at': datetime.datetime(2026, 4, 2, 8, 20, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 8, 20, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/100d2cbf-7145-49cd-863b-c1e137045ce3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f63635dc7c0>}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:16 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac9a75c1-7218-4b54-be05-5158e40a527a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:16 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac9a75c1-7218-4b54-be05-5158e40a527a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:16 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d68c3d2b-fd9f-4bd2-af93-43d3c2e440df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:16 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Volume 34d6d557-e4bb-479b-9939-b32c59d38629: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-34d6d557-e4bb-479b-9939-b32c59d38629', 'volume_size': 1, 'image_id': '100d2cbf-7145-49cd-863b-c1e137045ce3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/100d2cbf-7145-49cd-863b-c1e137045ce3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e7bc1c1d4b5544979a3d9a5428cd3e5d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '100d2cbf-7145-49cd-863b-c1e137045ce3', 'created_at': datetime.datetime(2026, 4, 2, 8, 20, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 8, 20, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/100d2cbf-7145-49cd-863b-c1e137045ce3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f63635dc7c0>}
Apr 02 10:27:16 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Trying to clone 34d6d557-e4bb-479b-9939-b32c59d38629 from image 100d2cbf-7145-49cd-863b-c1e137045ce3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/100d2cbf-7145-49cd-863b-c1e137045ce3', 'metadata': {}}]). {{(pid=82102) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 02 10:27:16 devstack sudo[85362]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-09c6588a-619f-4548-b1c7-f2b799f38462 tempest-SnapshotMetadataTestJSON-2027062647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505.657c51c0-c6a8-4581-8431-591787c874b7 1G" returned: 0 in 0.727s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-09c6588a-619f-4548-b1c7-f2b799f38462 tempest-SnapshotMetadataTestJSON-2027062647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73db9625-74c0-4c83-8172-efc9f5d7e505 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505.657c51c0-c6a8-4581-8431-591787c874b7 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:16 devstack sudo[85369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73db9625-74c0-4c83-8172-efc9f5d7e505 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505.657c51c0-c6a8-4581-8431-591787c874b7
Apr 02 10:27:16 devstack sudo[85369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:16 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_q_d9kac0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82102) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 02 10:27:16 devstack cinder-volume[82102]: INFO cinder.image.image_utils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Image download 20.69 MB at 20.69 MB/s
Apr 02 10:27:16 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[021c083d-86da-43ac-be5c-9aac139f5ea9]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_q_d9kac0devstack@QuobyteHD {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:16 devstack sudo[85372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_q_d9kac0devstack@QuobyteHD
Apr 02 10:27:16 devstack sudo[85372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:17 devstack sudo[85369]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-09c6588a-619f-4548-b1c7-f2b799f38462 tempest-SnapshotMetadataTestJSON-2027062647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73db9625-74c0-4c83-8172-efc9f5d7e505 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505.657c51c0-c6a8-4581-8431-591787c874b7" returned: 0 in 0.853s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:17 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-09c6588a-619f-4548-b1c7-f2b799f38462 tempest-SnapshotMetadataTestJSON-2027062647 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505.657c51c0-c6a8-4581-8431-591787c874b7 is being set with open permissions: ugo+rw
Apr 02 10:27:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-09c6588a-619f-4548-b1c7-f2b799f38462 tempest-SnapshotMetadataTestJSON-2027062647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505.657c51c0-c6a8-4581-8431-591787c874b7 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:17 devstack sudo[85378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505.657c51c0-c6a8-4581-8431-591787c874b7
Apr 02 10:27:17 devstack sudo[85378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:17 devstack sudo[85372]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_q_d9kac0devstack@QuobyteHD" returned: 0 in 0.701s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:17 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Temporary image 100d2cbf-7145-49cd-863b-c1e137045ce3 is fetched for user 5dc477cddeb04c1e9699cbbe7485783d. {{(pid=82102) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 02 10:27:17 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2f5443-3e84-4d00-b77e-27ae25eae728]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_q_d9kac0devstack@QuobyteHD {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:17 devstack sudo[85383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_q_d9kac0devstack@QuobyteHD
Apr 02 10:27:17 devstack sudo[85383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:17 devstack sudo[85378]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-09c6588a-619f-4548-b1c7-f2b799f38462 tempest-SnapshotMetadataTestJSON-2027062647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505.657c51c0-c6a8-4581-8431-591787c874b7" returned: 0 in 0.754s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-09c6588a-619f-4548-b1c7-f2b799f38462 tempest-SnapshotMetadataTestJSON-2027062647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:17 devstack sudo[85386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505.info
Apr 02 10:27:17 devstack sudo[85386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:18 devstack sudo[85383]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_q_d9kac0devstack@QuobyteHD" returned: 0 in 0.954s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:27:18 devstack sudo[85386]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-09c6588a-619f-4548-b1c7-f2b799f38462 tempest-SnapshotMetadataTestJSON-2027062647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505.info" returned: 0 in 0.625s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:18 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-09c6588a-619f-4548-b1c7-f2b799f38462 tempest-SnapshotMetadataTestJSON-2027062647 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505.info is being set with open permissions: ugo+rw
Apr 02 10:27:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-09c6588a-619f-4548-b1c7-f2b799f38462 tempest-SnapshotMetadataTestJSON-2027062647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:18 devstack sudo[85393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505.info
Apr 02 10:27:18 devstack sudo[85393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:19 devstack sudo[85393]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-09c6588a-619f-4548-b1c7-f2b799f38462 tempest-SnapshotMetadataTestJSON-2027062647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505.info" returned: 0 in 0.761s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-09c6588a-619f-4548-b1c7-f2b799f38462 tempest-SnapshotMetadataTestJSON-2027062647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.846s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:27:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.953s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:27:19 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:27:16Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34d6d557-e4bb-479b-9939-b32c59d38629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af18d76a2c2944d2b74a750e7dbbc2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:27:16Z,use_quota=True,user_id='5dc477cddeb04c1e9699cbbe7485783d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:27:19 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Creating volume 34d6d557-e4bb-479b-9939-b32c59d38629 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:27:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:27:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:27:19 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:27:19 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:27:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:27:19 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:27:19 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:27:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:19 devstack sudo[85396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629 1073741824
Apr 02 10:27:19 devstack sudo[85396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:19 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-09c6588a-619f-4548-b1c7-f2b799f38462 tempest-SnapshotMetadataTestJSON-2027062647 None] Create snapshot completed successfully
Apr 02 10:27:20 devstack sudo[85396]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629 1073741824" returned: 0 in 1.191s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:20 devstack sudo[85404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629
Apr 02 10:27:20 devstack sudo[85404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:20 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-194515c4-2de1-4596-9a74-0d7fbb5344ac tempest-SnapshotMetadataTestJSON-2027062647 None] Acquiring lock "cinder-657c51c0-c6a8-4581-8431-591787c874b7-delete_snapshot" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:27:20 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-194515c4-2de1-4596-9a74-0d7fbb5344ac tempest-SnapshotMetadataTestJSON-2027062647 None] Lock "cinder-657c51c0-c6a8-4581-8431-591787c874b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:27:20 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-194515c4-2de1-4596-9a74-0d7fbb5344ac tempest-SnapshotMetadataTestJSON-2027062647 None] Acquiring lock "cinder-quobyte-73db9625-74c0-4c83-8172-efc9f5d7e505" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:27:20 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-194515c4-2de1-4596-9a74-0d7fbb5344ac tempest-SnapshotMetadataTestJSON-2027062647 None] Lock "cinder-quobyte-73db9625-74c0-4c83-8172-efc9f5d7e505" acquired by "delete_snapshot" :: waited 0.039s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:27:20 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-194515c4-2de1-4596-9a74-0d7fbb5344ac tempest-SnapshotMetadataTestJSON-2027062647 None] Acquiring lock "cinder-quobyte-657c51c0-c6a8-4581-8431-591787c874b7" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:27:20 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-194515c4-2de1-4596-9a74-0d7fbb5344ac tempest-SnapshotMetadataTestJSON-2027062647 None] Lock "cinder-quobyte-657c51c0-c6a8-4581-8431-591787c874b7" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:27:20 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-194515c4-2de1-4596-9a74-0d7fbb5344ac tempest-SnapshotMetadataTestJSON-2027062647 None] Deleting offline snapshot 657c51c0-c6a8-4581-8431-591787c874b7 of volume 73db9625-74c0-4c83-8172-efc9f5d7e505 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:27:20 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-194515c4-2de1-4596-9a74-0d7fbb5344ac tempest-SnapshotMetadataTestJSON-2027062647 None] snapshot_file for this snap is: volume-73db9625-74c0-4c83-8172-efc9f5d7e505.657c51c0-c6a8-4581-8431-591787c874b7 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:27:20 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5575da5e-23e8-4fbc-beeb-491317cbce1d]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-194515c4-2de1-4596-9a74-0d7fbb5344ac tempest-SnapshotMetadataTestJSON-2027062647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505.657c51c0-c6a8-4581-8431-591787c874b7 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:20 devstack sudo[85408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505.657c51c0-c6a8-4581-8431-591787c874b7
Apr 02 10:27:20 devstack sudo[85408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:21 devstack sudo[85408]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-194515c4-2de1-4596-9a74-0d7fbb5344ac tempest-SnapshotMetadataTestJSON-2027062647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505.657c51c0-c6a8-4581-8431-591787c874b7" returned: 0 in 0.681s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:21 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-194515c4-2de1-4596-9a74-0d7fbb5344ac tempest-SnapshotMetadataTestJSON-2027062647 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73db9625-74c0-4c83-8172-efc9f5d7e505(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:27:21 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2b7b83-bcf8-48be-afe9-88d78465faea]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-194515c4-2de1-4596-9a74-0d7fbb5344ac tempest-SnapshotMetadataTestJSON-2027062647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:21 devstack sudo[85404]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629" returned: 0 in 0.916s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:21 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] <== create_volume: return (2166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:27:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.171s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:27:21 devstack cinder-volume[82102]: DEBUG cinder.volume.volume_utils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Attempting download of 100d2cbf-7145-49cd-863b-c1e137045ce3 ((None, [{'url': 'file:///opt/stack/data/glance/images/100d2cbf-7145-49cd-863b-c1e137045ce3', 'metadata': {}}])) to volume 34d6d557-e4bb-479b-9939-b32c59d38629. {{(pid=82102) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 02 10:27:21 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc102841-2986-4d2c-b6b4-e51fb3ff2bb8]: (4, 'raw') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_100d2cbf-7145-49cd-863b-c1e137045ce3_7by2qh6g {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:21 devstack sudo[85417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505
Apr 02 10:27:21 devstack sudo[85417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:21 devstack sudo[85427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_100d2cbf-7145-49cd-863b-c1e137045ce3_7by2qh6g
Apr 02 10:27:21 devstack sudo[85427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:21 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-02f4f246-4919-4df8-b3d0-b20709b5518e tempest-SnapshotsActionsTest-1702071401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:27:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-02f4f246-4919-4df8-b3d0-b20709b5518e tempest-SnapshotsActionsTest-1702071401 None] Flow 'volume_create_manager' (56fea384-166f-469d-adb8-4a141c162584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:27:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-02f4f246-4919-4df8-b3d0-b20709b5518e tempest-SnapshotsActionsTest-1702071401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d044b957-5fac-4b23-a2ce-0c83b6eed3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-02f4f246-4919-4df8-b3d0-b20709b5518e tempest-SnapshotsActionsTest-1702071401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d044b957-5fac-4b23-a2ce-0c83b6eed3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-343963386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93162c96-8352-4cd5-a05e-f5a59c6083d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b03105221f8040a594397d4f5258c6cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:27:22Z,use_quota=True,user_id='73a53c6836284f93ab2ad93cf005b87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-02f4f246-4919-4df8-b3d0-b20709b5518e tempest-SnapshotsActionsTest-1702071401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c915eba-1f75-43e9-84aa-220fe8f71394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-02f4f246-4919-4df8-b3d0-b20709b5518e tempest-SnapshotsActionsTest-1702071401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c915eba-1f75-43e9-84aa-220fe8f71394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-02f4f246-4919-4df8-b3d0-b20709b5518e tempest-SnapshotsActionsTest-1702071401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53b500ce-8236-481e-8fc0-7d60f0a92865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-02f4f246-4919-4df8-b3d0-b20709b5518e tempest-SnapshotsActionsTest-1702071401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53b500ce-8236-481e-8fc0-7d60f0a92865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93162c96-8352-4cd5-a05e-f5a59c6083d5', 'volume_name': 'volume-93162c96-8352-4cd5-a05e-f5a59c6083d5', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-02f4f246-4919-4df8-b3d0-b20709b5518e tempest-SnapshotsActionsTest-1702071401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a58ec5c2-061e-49f1-b663-19fd72d39e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-02f4f246-4919-4df8-b3d0-b20709b5518e tempest-SnapshotsActionsTest-1702071401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a58ec5c2-061e-49f1-b663-19fd72d39e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-02f4f246-4919-4df8-b3d0-b20709b5518e tempest-SnapshotsActionsTest-1702071401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d29c957-0bab-4d2e-b0a1-4b4e3bb7393d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:22 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-02f4f246-4919-4df8-b3d0-b20709b5518e tempest-SnapshotsActionsTest-1702071401 None] Volume 93162c96-8352-4cd5-a05e-f5a59c6083d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93162c96-8352-4cd5-a05e-f5a59c6083d5', 'volume_size': 1}
Apr 02 10:27:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-02f4f246-4919-4df8-b3d0-b20709b5518e tempest-SnapshotsActionsTest-1702071401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:27:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-02f4f246-4919-4df8-b3d0-b20709b5518e tempest-SnapshotsActionsTest-1702071401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:27:22 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-02f4f246-4919-4df8-b3d0-b20709b5518e tempest-SnapshotsActionsTest-1702071401 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-343963386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93162c96-8352-4cd5-a05e-f5a59c6083d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b03105221f8040a594397d4f5258c6cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:27:22Z,use_quota=True,user_id='73a53c6836284f93ab2ad93cf005b87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:27:22 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-02f4f246-4919-4df8-b3d0-b20709b5518e tempest-SnapshotsActionsTest-1702071401 None] Creating volume 93162c96-8352-4cd5-a05e-f5a59c6083d5 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:27:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-02f4f246-4919-4df8-b3d0-b20709b5518e tempest-SnapshotsActionsTest-1702071401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:27:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-02f4f246-4919-4df8-b3d0-b20709b5518e tempest-SnapshotsActionsTest-1702071401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:27:22 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-02f4f246-4919-4df8-b3d0-b20709b5518e tempest-SnapshotsActionsTest-1702071401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:27:22 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-02f4f246-4919-4df8-b3d0-b20709b5518e tempest-SnapshotsActionsTest-1702071401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:27:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-02f4f246-4919-4df8-b3d0-b20709b5518e tempest-SnapshotsActionsTest-1702071401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:27:22 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-02f4f246-4919-4df8-b3d0-b20709b5518e tempest-SnapshotsActionsTest-1702071401 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:27:22 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-02f4f246-4919-4df8-b3d0-b20709b5518e tempest-SnapshotsActionsTest-1702071401 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:27:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-02f4f246-4919-4df8-b3d0-b20709b5518e tempest-SnapshotsActionsTest-1702071401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:22 devstack sudo[85430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5 1073741824
Apr 02 10:27:22 devstack sudo[85430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:22 devstack sudo[85417]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-194515c4-2de1-4596-9a74-0d7fbb5344ac tempest-SnapshotMetadataTestJSON-2027062647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505" returned: 0 in 0.869s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-194515c4-2de1-4596-9a74-0d7fbb5344ac tempest-SnapshotMetadataTestJSON-2027062647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505.657c51c0-c6a8-4581-8431-591787c874b7 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:22 devstack sudo[85438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505.657c51c0-c6a8-4581-8431-591787c874b7
Apr 02 10:27:22 devstack sudo[85438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:22 devstack sudo[85427]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_100d2cbf-7145-49cd-863b-c1e137045ce3_7by2qh6g" returned: 0 in 0.816s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_100d2cbf-7145-49cd-863b-c1e137045ce3_7by2qh6g {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:22 devstack sudo[85440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_100d2cbf-7145-49cd-863b-c1e137045ce3_7by2qh6g
Apr 02 10:27:22 devstack sudo[85440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:23 devstack sudo[85430]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-02f4f246-4919-4df8-b3d0-b20709b5518e tempest-SnapshotsActionsTest-1702071401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5 1073741824" returned: 0 in 0.857s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-02f4f246-4919-4df8-b3d0-b20709b5518e tempest-SnapshotsActionsTest-1702071401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:23 devstack sudo[85464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5
Apr 02 10:27:23 devstack sudo[85464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:23 devstack sudo[85438]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-194515c4-2de1-4596-9a74-0d7fbb5344ac tempest-SnapshotMetadataTestJSON-2027062647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505.657c51c0-c6a8-4581-8431-591787c874b7" returned: 0 in 0.766s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-194515c4-2de1-4596-9a74-0d7fbb5344ac tempest-SnapshotMetadataTestJSON-2027062647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505.657c51c0-c6a8-4581-8431-591787c874b7 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:23 devstack sudo[85469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505.657c51c0-c6a8-4581-8431-591787c874b7
Apr 02 10:27:23 devstack sudo[85469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:23 devstack sudo[85440]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_100d2cbf-7145-49cd-863b-c1e137045ce3_7by2qh6g" returned: 1 in 0.850s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_100d2cbf-7145-49cd-863b-c1e137045ce3_7by2qh6g' failed. Not Retrying. {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 02 10:27:23 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0b9f5e-998f-49aa-99b5-65fe75614b10]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_q_d9kac0devstack@QuobyteHD {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:23 devstack sudo[85471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_q_d9kac0devstack@QuobyteHD
Apr 02 10:27:23 devstack sudo[85471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:23 devstack sudo[85464]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-02f4f246-4919-4df8-b3d0-b20709b5518e tempest-SnapshotsActionsTest-1702071401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5" returned: 0 in 0.585s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:23 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-02f4f246-4919-4df8-b3d0-b20709b5518e tempest-SnapshotsActionsTest-1702071401 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:27:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-02f4f246-4919-4df8-b3d0-b20709b5518e tempest-SnapshotsActionsTest-1702071401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:27:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-02f4f246-4919-4df8-b3d0-b20709b5518e tempest-SnapshotsActionsTest-1702071401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d29c957-0bab-4d2e-b0a1-4b4e3bb7393d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93162c96-8352-4cd5-a05e-f5a59c6083d5', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-02f4f246-4919-4df8-b3d0-b20709b5518e tempest-SnapshotsActionsTest-1702071401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8ab5511-69cc-431c-92fd-685f9b045acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:23 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-02f4f246-4919-4df8-b3d0-b20709b5518e tempest-SnapshotsActionsTest-1702071401 None] Volume volume-93162c96-8352-4cd5-a05e-f5a59c6083d5 (93162c96-8352-4cd5-a05e-f5a59c6083d5): created successfully
Apr 02 10:27:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-02f4f246-4919-4df8-b3d0-b20709b5518e tempest-SnapshotsActionsTest-1702071401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8ab5511-69cc-431c-92fd-685f9b045acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-02f4f246-4919-4df8-b3d0-b20709b5518e tempest-SnapshotsActionsTest-1702071401 None] Flow 'volume_create_manager' (56fea384-166f-469d-adb8-4a141c162584) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:27:23 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-02f4f246-4919-4df8-b3d0-b20709b5518e tempest-SnapshotsActionsTest-1702071401 None] Created volume successfully.
Apr 02 10:27:23 devstack sudo[85469]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-194515c4-2de1-4596-9a74-0d7fbb5344ac tempest-SnapshotMetadataTestJSON-2027062647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505.657c51c0-c6a8-4581-8431-591787c874b7" returned: 0 in 0.639s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:23 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-194515c4-2de1-4596-9a74-0d7fbb5344ac tempest-SnapshotMetadataTestJSON-2027062647 None] Lock "cinder-quobyte-657c51c0-c6a8-4581-8431-591787c874b7" released by "_delete_snapshot" :: held 3.019s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:27:23 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-194515c4-2de1-4596-9a74-0d7fbb5344ac tempest-SnapshotMetadataTestJSON-2027062647 None] Lock "cinder-quobyte-73db9625-74c0-4c83-8172-efc9f5d7e505" released by "delete_snapshot" :: held 3.034s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:27:23 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-194515c4-2de1-4596-9a74-0d7fbb5344ac tempest-SnapshotMetadataTestJSON-2027062647 None] Created reservations ['f5c8a734-7c31-4350-aedf-6386ee01e16c', '20d8e331-398d-4791-97c2-84df58b6b083', 'fbb87932-59a8-44b6-b634-befb7daac61e', '4ada956a-7fa6-45a1-b797-24ec517294f6'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:27:24 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-194515c4-2de1-4596-9a74-0d7fbb5344ac tempest-SnapshotMetadataTestJSON-2027062647 None] Delete snapshot completed successfully.
Apr 02 10:27:24 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-194515c4-2de1-4596-9a74-0d7fbb5344ac tempest-SnapshotMetadataTestJSON-2027062647 None] Lock "cinder-657c51c0-c6a8-4581-8431-591787c874b7-delete_snapshot" released by "delete_snapshot" :: held 3.283s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:27:24 devstack sudo[85471]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_q_d9kac0devstack@QuobyteHD" returned: 0 in 0.702s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:24 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] 100d2cbf-7145-49cd-863b-c1e137045ce3 was qcow2, converting to raw {{(pid=82102) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 02 10:27:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_q_d9kac0devstack@QuobyteHD /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:24 devstack sudo[85478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_q_d9kac0devstack@QuobyteHD /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629
Apr 02 10:27:24 devstack sudo[85478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a7a1ef63-37ab-4aad-b538-9d7cfb8adb16 tempest-SnapshotsActionsTest-1702071401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:27:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a7a1ef63-37ab-4aad-b538-9d7cfb8adb16 tempest-SnapshotsActionsTest-1702071401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:27:24 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-a7a1ef63-37ab-4aad-b538-9d7cfb8adb16 tempest-SnapshotsActionsTest-1702071401 None] Creating offline snapshot 7d966108-7f52-413e-834d-32384f7bfa48 of volume 93162c96-8352-4cd5-a05e-f5a59c6083d5 {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:27:24 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6ffe97-14d6-4bd6-87e7-4119ecad47af]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a7a1ef63-37ab-4aad-b538-9d7cfb8adb16 tempest-SnapshotsActionsTest-1702071401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:24 devstack sudo[85480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5
Apr 02 10:27:24 devstack sudo[85480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:25 devstack sudo[85480]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a7a1ef63-37ab-4aad-b538-9d7cfb8adb16 tempest-SnapshotsActionsTest-1702071401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5" returned: 0 in 0.722s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a7a1ef63-37ab-4aad-b538-9d7cfb8adb16 tempest-SnapshotsActionsTest-1702071401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:25 devstack sudo[85492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48 1G
Apr 02 10:27:25 devstack sudo[85492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:25 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1e0af38a-f880-4ae3-ad8b-48a1f66e7512 tempest-SnapshotMetadataTestJSON-2027062647 None] Acquiring lock "cinder-73db9625-74c0-4c83-8172-efc9f5d7e505-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:27:25 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1e0af38a-f880-4ae3-ad8b-48a1f66e7512 tempest-SnapshotMetadataTestJSON-2027062647 None] Lock "cinder-73db9625-74c0-4c83-8172-efc9f5d7e505-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:27:25 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1e0af38a-f880-4ae3-ad8b-48a1f66e7512 tempest-SnapshotMetadataTestJSON-2027062647 None] Acquiring lock "cinder-quobyte-73db9625-74c0-4c83-8172-efc9f5d7e505" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:27:25 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1e0af38a-f880-4ae3-ad8b-48a1f66e7512 tempest-SnapshotMetadataTestJSON-2027062647 None] Lock "cinder-quobyte-73db9625-74c0-4c83-8172-efc9f5d7e505" acquired by "delete_volume" :: waited 0.023s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:27:25 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[561eeb54-0f8d-41f2-812b-10d58a16a2fb]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1e0af38a-f880-4ae3-ad8b-48a1f66e7512 tempest-SnapshotMetadataTestJSON-2027062647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:25 devstack sudo[85478]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_q_d9kac0devstack@QuobyteHD /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629" returned: 0 in 1.368s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:25 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_q_d9kac0devstack@QuobyteHD, size 112.00 MB, duration 1.37 sec, destination /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629 {{(pid=82102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 02 10:27:25 devstack cinder-volume[82102]: INFO cinder.image.image_utils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Converted 112.00 MB image at 81.77 MB/s
Apr 02 10:27:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:25 devstack sudo[85494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505
Apr 02 10:27:25 devstack sudo[85494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:25 devstack sudo[85495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629 1G
Apr 02 10:27:25 devstack sudo[85495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:25 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [req-687f7943-b208-49e4-9b3c-4ab9d2115405 req-69577807-766d-434a-acd8-9d316fd01615 tempest-VolumesSnapshotsTestJSON-1217673121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:27:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-687f7943-b208-49e4-9b3c-4ab9d2115405 req-69577807-766d-434a-acd8-9d316fd01615 tempest-VolumesSnapshotsTestJSON-1217673121 None] Flow 'volume_create_manager' (fa14eb54-430b-402e-9552-e71ad0566816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:27:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-687f7943-b208-49e4-9b3c-4ab9d2115405 req-69577807-766d-434a-acd8-9d316fd01615 tempest-VolumesSnapshotsTestJSON-1217673121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c3c51fd-9c30-47c6-a7f7-d7a04f6e533b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-687f7943-b208-49e4-9b3c-4ab9d2115405 req-69577807-766d-434a-acd8-9d316fd01615 tempest-VolumesSnapshotsTestJSON-1217673121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c3c51fd-9c30-47c6-a7f7-d7a04f6e533b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1050835187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=685c344f-1fce-410f-bce9-183af10a5c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bfb11a8dc694d50b803908aa2990bdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:27:26Z,use_quota=True,user_id='13c87fc4dc7d4a7cb143f1774acfd272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-687f7943-b208-49e4-9b3c-4ab9d2115405 req-69577807-766d-434a-acd8-9d316fd01615 tempest-VolumesSnapshotsTestJSON-1217673121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e586d4fb-8b97-4f47-ac2d-bff3840f9cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-687f7943-b208-49e4-9b3c-4ab9d2115405 req-69577807-766d-434a-acd8-9d316fd01615 tempest-VolumesSnapshotsTestJSON-1217673121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e586d4fb-8b97-4f47-ac2d-bff3840f9cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-687f7943-b208-49e4-9b3c-4ab9d2115405 req-69577807-766d-434a-acd8-9d316fd01615 tempest-VolumesSnapshotsTestJSON-1217673121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (009850c4-c853-4178-ad02-e6d778479d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-687f7943-b208-49e4-9b3c-4ab9d2115405 req-69577807-766d-434a-acd8-9d316fd01615 tempest-VolumesSnapshotsTestJSON-1217673121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (009850c4-c853-4178-ad02-e6d778479d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '685c344f-1fce-410f-bce9-183af10a5c50', 'volume_name': 'volume-685c344f-1fce-410f-bce9-183af10a5c50', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-687f7943-b208-49e4-9b3c-4ab9d2115405 req-69577807-766d-434a-acd8-9d316fd01615 tempest-VolumesSnapshotsTestJSON-1217673121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c9ef2db-b5c5-4c28-8f9a-4b75161f07b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-687f7943-b208-49e4-9b3c-4ab9d2115405 req-69577807-766d-434a-acd8-9d316fd01615 tempest-VolumesSnapshotsTestJSON-1217673121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c9ef2db-b5c5-4c28-8f9a-4b75161f07b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-687f7943-b208-49e4-9b3c-4ab9d2115405 req-69577807-766d-434a-acd8-9d316fd01615 tempest-VolumesSnapshotsTestJSON-1217673121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (badbf372-8277-4421-8808-4421845dd25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:25 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [req-687f7943-b208-49e4-9b3c-4ab9d2115405 req-69577807-766d-434a-acd8-9d316fd01615 tempest-VolumesSnapshotsTestJSON-1217673121 None] Volume 685c344f-1fce-410f-bce9-183af10a5c50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-685c344f-1fce-410f-bce9-183af10a5c50', 'volume_size': 1}
Apr 02 10:27:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-687f7943-b208-49e4-9b3c-4ab9d2115405 req-69577807-766d-434a-acd8-9d316fd01615 tempest-VolumesSnapshotsTestJSON-1217673121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:27:25 devstack sudo[85492]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a7a1ef63-37ab-4aad-b538-9d7cfb8adb16 tempest-SnapshotsActionsTest-1702071401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48 1G" returned: 0 in 0.852s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a7a1ef63-37ab-4aad-b538-9d7cfb8adb16 tempest-SnapshotsActionsTest-1702071401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93162c96-8352-4cd5-a05e-f5a59c6083d5 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:25 devstack sudo[85501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93162c96-8352-4cd5-a05e-f5a59c6083d5 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48
Apr 02 10:27:25 devstack sudo[85501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:26 devstack sudo[85495]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629 1G" returned: 0 in 0.612s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:26 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[674c8fae-f85e-4a6e-ac7a-a80bc2138b91]: (4, 'raw') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:26 devstack sudo[85494]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1e0af38a-f880-4ae3-ad8b-48a1f66e7512 tempest-SnapshotMetadataTestJSON-2027062647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505" returned: 0 in 0.817s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1e0af38a-f880-4ae3-ad8b-48a1f66e7512 tempest-SnapshotMetadataTestJSON-2027062647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:26 devstack sudo[85510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505
Apr 02 10:27:26 devstack sudo[85510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:26 devstack sudo[85509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629
Apr 02 10:27:26 devstack sudo[85509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:26 devstack sudo[85501]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a7a1ef63-37ab-4aad-b538-9d7cfb8adb16 tempest-SnapshotsActionsTest-1702071401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93162c96-8352-4cd5-a05e-f5a59c6083d5 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48" returned: 0 in 0.546s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:26 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-a7a1ef63-37ab-4aad-b538-9d7cfb8adb16 tempest-SnapshotsActionsTest-1702071401 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48 is being set with open permissions: ugo+rw
Apr 02 10:27:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a7a1ef63-37ab-4aad-b538-9d7cfb8adb16 tempest-SnapshotsActionsTest-1702071401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:26 devstack sudo[85516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48
Apr 02 10:27:26 devstack sudo[85516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:26 devstack sudo[85510]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1e0af38a-f880-4ae3-ad8b-48a1f66e7512 tempest-SnapshotMetadataTestJSON-2027062647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73db9625-74c0-4c83-8172-efc9f5d7e505" returned: 0 in 0.551s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:26 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1e0af38a-f880-4ae3-ad8b-48a1f66e7512 tempest-SnapshotMetadataTestJSON-2027062647 None] Lock "cinder-quobyte-73db9625-74c0-4c83-8172-efc9f5d7e505" released by "delete_volume" :: held 1.409s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:27:26 devstack sudo[85509]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629" returned: 0 in 0.637s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:26 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-1e0af38a-f880-4ae3-ad8b-48a1f66e7512 tempest-SnapshotMetadataTestJSON-2027062647 None] Created reservations ['18705e99-6704-4bc6-b74b-8b532609fd7a', '30b5ac23-590d-4788-8d60-3b8f58674c02', '48d1544d-00f5-4f84-bb78-3a28a4edc794', 'cd7db0df-6ba0-4cb9-92b1-ffb94c80d392'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:27:26 devstack sudo[85521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629
Apr 02 10:27:26 devstack sudo[85521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-1e0af38a-f880-4ae3-ad8b-48a1f66e7512 tempest-SnapshotMetadataTestJSON-2027062647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:27:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-1e0af38a-f880-4ae3-ad8b-48a1f66e7512 tempest-SnapshotMetadataTestJSON-2027062647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:27:26 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-1e0af38a-f880-4ae3-ad8b-48a1f66e7512 tempest-SnapshotMetadataTestJSON-2027062647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:27:26 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-1e0af38a-f880-4ae3-ad8b-48a1f66e7512 tempest-SnapshotMetadataTestJSON-2027062647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:27:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-1e0af38a-f880-4ae3-ad8b-48a1f66e7512 tempest-SnapshotMetadataTestJSON-2027062647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:27:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1e0af38a-f880-4ae3-ad8b-48a1f66e7512 tempest-SnapshotMetadataTestJSON-2027062647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:26 devstack sudo[85523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:27:26 devstack sudo[85523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:26 devstack sudo[85516]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a7a1ef63-37ab-4aad-b538-9d7cfb8adb16 tempest-SnapshotsActionsTest-1702071401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48" returned: 0 in 0.535s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a7a1ef63-37ab-4aad-b538-9d7cfb8adb16 tempest-SnapshotsActionsTest-1702071401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:27 devstack sudo[85526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.info
Apr 02 10:27:27 devstack sudo[85526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:27 devstack sudo[85521]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629" returned: 1 in 0.528s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629' failed. Not Retrying. {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 02 10:27:27 devstack cinder-volume[82102]: DEBUG cinder.volume.volume_utils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Downloaded image 100d2cbf-7145-49cd-863b-c1e137045ce3 ((None, [{'url': 'file:///opt/stack/data/glance/images/100d2cbf-7145-49cd-863b-c1e137045ce3', 'metadata': {}}])) to volume 34d6d557-e4bb-479b-9939-b32c59d38629 successfully. {{(pid=82102) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 02 10:27:27 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Temporary image 100d2cbf-7145-49cd-863b-c1e137045ce3 for user 5dc477cddeb04c1e9699cbbe7485783d is deleted. {{(pid=82102) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 02 10:27:27 devstack cinder-volume[82102]: DEBUG cinder.volume.volume_utils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Marking volume 34d6d557-e4bb-479b-9939-b32c59d38629 as bootable. {{(pid=82102) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 02 10:27:27 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Copying metadata from image 100d2cbf-7145-49cd-863b-c1e137045ce3 to 34d6d557-e4bb-479b-9939-b32c59d38629. {{(pid=82102) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 02 10:27:27 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Creating volume glance metadata for volume 34d6d557-e4bb-479b-9939-b32c59d38629 backed by image 100d2cbf-7145-49cd-863b-c1e137045ce3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '100d2cbf-7145-49cd-863b-c1e137045ce3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82102) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 02 10:27:27 devstack sudo[85523]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1e0af38a-f880-4ae3-ad8b-48a1f66e7512 tempest-SnapshotMetadataTestJSON-2027062647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.494s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:27 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-1e0af38a-f880-4ae3-ad8b-48a1f66e7512 tempest-SnapshotMetadataTestJSON-2027062647 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:27:27 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d68c3d2b-fd9f-4bd2-af93-43d3c2e440df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34d6d557-e4bb-479b-9939-b32c59d38629', 'volume_size': 1, 'image_id': '100d2cbf-7145-49cd-863b-c1e137045ce3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/100d2cbf-7145-49cd-863b-c1e137045ce3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e7bc1c1d4b5544979a3d9a5428cd3e5d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '100d2cbf-7145-49cd-863b-c1e137045ce3', 'created_at': datetime.datetime(2026, 4, 2, 8, 20, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 8, 20, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/100d2cbf-7145-49cd-863b-c1e137045ce3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f63635dc7c0>}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:27 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c356fbda-1986-4c2c-b189-893db4d11ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:27 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-1e0af38a-f880-4ae3-ad8b-48a1f66e7512 tempest-SnapshotMetadataTestJSON-2027062647 None] Deleted volume successfully.
Apr 02 10:27:27 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Volume volume-34d6d557-e4bb-479b-9939-b32c59d38629 (34d6d557-e4bb-479b-9939-b32c59d38629): created successfully
Apr 02 10:27:27 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c356fbda-1986-4c2c-b189-893db4d11ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:27 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Flow 'volume_create_manager' (e7ba0d43-7d4f-4d01-ae78-730498e7dd65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:27:27 devstack cinder-volume[82102]: INFO cinder.volume.manager [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-f381d7f1-6080-4536-adc0-d4e1922a3113 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Created volume successfully.
Apr 02 10:27:27 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1e0af38a-f880-4ae3-ad8b-48a1f66e7512 tempest-SnapshotMetadataTestJSON-2027062647 None] Lock "cinder-73db9625-74c0-4c83-8172-efc9f5d7e505-delete_volume" released by "delete_volume" :: held 2.204s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:27:27 devstack sudo[85526]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a7a1ef63-37ab-4aad-b538-9d7cfb8adb16 tempest-SnapshotsActionsTest-1702071401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.info" returned: 0 in 0.474s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:27 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-a7a1ef63-37ab-4aad-b538-9d7cfb8adb16 tempest-SnapshotsActionsTest-1702071401 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.info is being set with open permissions: ugo+rw
Apr 02 10:27:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a7a1ef63-37ab-4aad-b538-9d7cfb8adb16 tempest-SnapshotsActionsTest-1702071401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:27 devstack sudo[85533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.info
Apr 02 10:27:27 devstack sudo[85533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:28 devstack sudo[85533]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a7a1ef63-37ab-4aad-b538-9d7cfb8adb16 tempest-SnapshotsActionsTest-1702071401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.info" returned: 0 in 0.546s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a7a1ef63-37ab-4aad-b538-9d7cfb8adb16 tempest-SnapshotsActionsTest-1702071401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.771s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:27:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-687f7943-b208-49e4-9b3c-4ab9d2115405 req-69577807-766d-434a-acd8-9d316fd01615 tempest-VolumesSnapshotsTestJSON-1217673121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.284s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:27:28 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [req-687f7943-b208-49e4-9b3c-4ab9d2115405 req-69577807-766d-434a-acd8-9d316fd01615 tempest-VolumesSnapshotsTestJSON-1217673121 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1050835187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=685c344f-1fce-410f-bce9-183af10a5c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bfb11a8dc694d50b803908aa2990bdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:27:26Z,use_quota=True,user_id='13c87fc4dc7d4a7cb143f1774acfd272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:27:28 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [req-687f7943-b208-49e4-9b3c-4ab9d2115405 req-69577807-766d-434a-acd8-9d316fd01615 tempest-VolumesSnapshotsTestJSON-1217673121 None] Creating volume 685c344f-1fce-410f-bce9-183af10a5c50 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:27:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-687f7943-b208-49e4-9b3c-4ab9d2115405 req-69577807-766d-434a-acd8-9d316fd01615 tempest-VolumesSnapshotsTestJSON-1217673121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:27:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-687f7943-b208-49e4-9b3c-4ab9d2115405 req-69577807-766d-434a-acd8-9d316fd01615 tempest-VolumesSnapshotsTestJSON-1217673121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:27:28 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [req-687f7943-b208-49e4-9b3c-4ab9d2115405 req-69577807-766d-434a-acd8-9d316fd01615 tempest-VolumesSnapshotsTestJSON-1217673121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:27:28 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [req-687f7943-b208-49e4-9b3c-4ab9d2115405 req-69577807-766d-434a-acd8-9d316fd01615 tempest-VolumesSnapshotsTestJSON-1217673121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:27:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-687f7943-b208-49e4-9b3c-4ab9d2115405 req-69577807-766d-434a-acd8-9d316fd01615 tempest-VolumesSnapshotsTestJSON-1217673121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:27:28 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [req-687f7943-b208-49e4-9b3c-4ab9d2115405 req-69577807-766d-434a-acd8-9d316fd01615 tempest-VolumesSnapshotsTestJSON-1217673121 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:27:28 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [req-687f7943-b208-49e4-9b3c-4ab9d2115405 req-69577807-766d-434a-acd8-9d316fd01615 tempest-VolumesSnapshotsTestJSON-1217673121 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:27:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-687f7943-b208-49e4-9b3c-4ab9d2115405 req-69577807-766d-434a-acd8-9d316fd01615 tempest-VolumesSnapshotsTestJSON-1217673121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:28 devstack sudo[85536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50 1073741824
Apr 02 10:27:28 devstack sudo[85536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:28 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-a7a1ef63-37ab-4aad-b538-9d7cfb8adb16 tempest-SnapshotsActionsTest-1702071401 None] Create snapshot completed successfully
Apr 02 10:27:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-9a6db786-9031-4e24-859c-50396b6b6f0e tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:27:28 devstack sudo[85536]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-687f7943-b208-49e4-9b3c-4ab9d2115405 req-69577807-766d-434a-acd8-9d316fd01615 tempest-VolumesSnapshotsTestJSON-1217673121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50 1073741824" returned: 0 in 0.737s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-687f7943-b208-49e4-9b3c-4ab9d2115405 req-69577807-766d-434a-acd8-9d316fd01615 tempest-VolumesSnapshotsTestJSON-1217673121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:28 devstack sudo[85551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50
Apr 02 10:27:28 devstack sudo[85551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d71aa511-1536-4170-811e-db207aa745f0 tempest-SnapshotsActionsTest-1702071401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:27:29 devstack sudo[85551]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-687f7943-b208-49e4-9b3c-4ab9d2115405 req-69577807-766d-434a-acd8-9d316fd01615 tempest-VolumesSnapshotsTestJSON-1217673121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50" returned: 0 in 0.668s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:29 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [req-687f7943-b208-49e4-9b3c-4ab9d2115405 req-69577807-766d-434a-acd8-9d316fd01615 tempest-VolumesSnapshotsTestJSON-1217673121 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:27:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-687f7943-b208-49e4-9b3c-4ab9d2115405 req-69577807-766d-434a-acd8-9d316fd01615 tempest-VolumesSnapshotsTestJSON-1217673121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:27:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-9a6db786-9031-4e24-859c-50396b6b6f0e tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.785s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:27:29 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-687f7943-b208-49e4-9b3c-4ab9d2115405 req-69577807-766d-434a-acd8-9d316fd01615 tempest-VolumesSnapshotsTestJSON-1217673121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (badbf372-8277-4421-8808-4421845dd25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-685c344f-1fce-410f-bce9-183af10a5c50', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:29 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-687f7943-b208-49e4-9b3c-4ab9d2115405 req-69577807-766d-434a-acd8-9d316fd01615 tempest-VolumesSnapshotsTestJSON-1217673121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f47fb60-c743-4271-bf83-078452f48d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:29 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [req-687f7943-b208-49e4-9b3c-4ab9d2115405 req-69577807-766d-434a-acd8-9d316fd01615 tempest-VolumesSnapshotsTestJSON-1217673121 None] Volume volume-685c344f-1fce-410f-bce9-183af10a5c50 (685c344f-1fce-410f-bce9-183af10a5c50): created successfully
Apr 02 10:27:29 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-687f7943-b208-49e4-9b3c-4ab9d2115405 req-69577807-766d-434a-acd8-9d316fd01615 tempest-VolumesSnapshotsTestJSON-1217673121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f47fb60-c743-4271-bf83-078452f48d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:29 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-687f7943-b208-49e4-9b3c-4ab9d2115405 req-69577807-766d-434a-acd8-9d316fd01615 tempest-VolumesSnapshotsTestJSON-1217673121 None] Flow 'volume_create_manager' (fa14eb54-430b-402e-9552-e71ad0566816) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:27:29 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a1e116-6c7d-4801-85eb-91b39810c0d7]: (4, 'raw') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-9a6db786-9031-4e24-859c-50396b6b6f0e tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:29 devstack cinder-volume[82102]: INFO cinder.volume.manager [req-687f7943-b208-49e4-9b3c-4ab9d2115405 req-69577807-766d-434a-acd8-9d316fd01615 tempest-VolumesSnapshotsTestJSON-1217673121 None] Created volume successfully.
Apr 02 10:27:29 devstack sudo[85554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629
Apr 02 10:27:29 devstack sudo[85554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:29 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a00ce9e-153a-4167-8141-4213a1ac24bf tempest-VolumesDeleteCascade-1697419128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:27:29 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-1a00ce9e-153a-4167-8141-4213a1ac24bf tempest-VolumesDeleteCascade-1697419128 None] Flow 'volume_create_manager' (f750a3b0-16d6-4847-b346-0bd55bff6ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:27:29 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-1a00ce9e-153a-4167-8141-4213a1ac24bf tempest-VolumesDeleteCascade-1697419128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c51bf210-0ce9-4f28-bd27-9aac0d9d5b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:29 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-1a00ce9e-153a-4167-8141-4213a1ac24bf tempest-VolumesDeleteCascade-1697419128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c51bf210-0ce9-4f28-bd27-9aac0d9d5b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-633122035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39462c73-bdbd-4dae-8767-23efb0fcd9d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dce5c061482a48959f920570c813ecd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:27:30Z,use_quota=True,user_id='490c3c25edd94111b560f07aff989618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:29 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-1a00ce9e-153a-4167-8141-4213a1ac24bf tempest-VolumesDeleteCascade-1697419128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6672fdf7-ed88-4d67-92a2-1d565c81e260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:29 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-1a00ce9e-153a-4167-8141-4213a1ac24bf tempest-VolumesDeleteCascade-1697419128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6672fdf7-ed88-4d67-92a2-1d565c81e260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:29 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-1a00ce9e-153a-4167-8141-4213a1ac24bf tempest-VolumesDeleteCascade-1697419128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (109dad95-3e6c-4dda-9517-80b5d8f0f4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:29 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-1a00ce9e-153a-4167-8141-4213a1ac24bf tempest-VolumesDeleteCascade-1697419128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (109dad95-3e6c-4dda-9517-80b5d8f0f4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39462c73-bdbd-4dae-8767-23efb0fcd9d9', 'volume_name': 'volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:30 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-1a00ce9e-153a-4167-8141-4213a1ac24bf tempest-VolumesDeleteCascade-1697419128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc4c31f3-732b-479a-a2e8-3ab56b6423b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:30 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-1a00ce9e-153a-4167-8141-4213a1ac24bf tempest-VolumesDeleteCascade-1697419128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc4c31f3-732b-479a-a2e8-3ab56b6423b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:30 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-1a00ce9e-153a-4167-8141-4213a1ac24bf tempest-VolumesDeleteCascade-1697419128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95074ec1-6de7-42a9-871a-45e32ff44f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:30 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-1a00ce9e-153a-4167-8141-4213a1ac24bf tempest-VolumesDeleteCascade-1697419128 None] Volume 39462c73-bdbd-4dae-8767-23efb0fcd9d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9', 'volume_size': 1}
Apr 02 10:27:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-1a00ce9e-153a-4167-8141-4213a1ac24bf tempest-VolumesDeleteCascade-1697419128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:27:30 devstack sudo[85554]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-9a6db786-9031-4e24-859c-50396b6b6f0e tempest-ServerBootFromVolumeStableRescueTest-182334840 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629" returned: 0 in 0.591s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-9a6db786-9031-4e24-859c-50396b6b6f0e tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-9350bfe1-4c37-4be6-a500-d5546223e43c req-0135757f-f151-4352-8e2b-0e51023eb528 tempest-VolumesSnapshotsTestJSON-1217673121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:27:30 devstack sudo[85558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629
Apr 02 10:27:30 devstack sudo[85558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:30 devstack sudo[85558]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-9a6db786-9031-4e24-859c-50396b6b6f0e tempest-ServerBootFromVolumeStableRescueTest-182334840 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629" returned: 1 in 0.536s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-9a6db786-9031-4e24-859c-50396b6b6f0e tempest-ServerBootFromVolumeStableRescueTest-182334840 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629' failed. Not Retrying. {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 02 10:27:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-9a6db786-9031-4e24-859c-50396b6b6f0e tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.177s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:27:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d71aa511-1536-4170-811e-db207aa745f0 tempest-SnapshotsActionsTest-1702071401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.478s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:27:30 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-d71aa511-1536-4170-811e-db207aa745f0 tempest-SnapshotsActionsTest-1702071401 None] Creating offline snapshot 0633c5c4-b382-4c29-9958-0bb655967d28 of volume 93162c96-8352-4cd5-a05e-f5a59c6083d5 {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:27:30 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fd38c2-5fa1-432b-b9cb-3057f6db86f4]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d71aa511-1536-4170-811e-db207aa745f0 tempest-SnapshotsActionsTest-1702071401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:30 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-9a6db786-9031-4e24-859c-50396b6b6f0e tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091', 'name': 'volume-34d6d557-e4bb-479b-9939-b32c59d38629', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1db5cdd0-e13d-4020-b644-26e938643d28', 'enforce_multipath': True} {{(pid=82102) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 02 10:27:30 devstack sudo[85563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48
Apr 02 10:27:30 devstack sudo[85563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:30 devstack cinder-volume[82102]: INFO cinder.volume.manager [req-7c226365-a485-40b8-8af2-9e839bff15b5 req-9a6db786-9031-4e24-859c-50396b6b6f0e tempest-ServerBootFromVolumeStableRescueTest-182334840 None] attachment_update completed successfully.
Apr 02 10:27:31 devstack sudo[85563]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d71aa511-1536-4170-811e-db207aa745f0 tempest-SnapshotsActionsTest-1702071401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48" returned: 0 in 0.473s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:31 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-d71aa511-1536-4170-811e-db207aa745f0 tempest-SnapshotsActionsTest-1702071401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93162c96-8352-4cd5-a05e-f5a59c6083d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:27:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d71aa511-1536-4170-811e-db207aa745f0 tempest-SnapshotsActionsTest-1702071401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.0633c5c4-b382-4c29-9958-0bb655967d28 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:31 devstack sudo[85569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.0633c5c4-b382-4c29-9958-0bb655967d28 1G
Apr 02 10:27:31 devstack sudo[85569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:31 devstack sudo[85569]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d71aa511-1536-4170-811e-db207aa745f0 tempest-SnapshotsActionsTest-1702071401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.0633c5c4-b382-4c29-9958-0bb655967d28 1G" returned: 0 in 0.629s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d71aa511-1536-4170-811e-db207aa745f0 tempest-SnapshotsActionsTest-1702071401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.0633c5c4-b382-4c29-9958-0bb655967d28 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:31 devstack sudo[85574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.0633c5c4-b382-4c29-9958-0bb655967d28
Apr 02 10:27:31 devstack sudo[85574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:32 devstack sudo[85574]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d71aa511-1536-4170-811e-db207aa745f0 tempest-SnapshotsActionsTest-1702071401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.0633c5c4-b382-4c29-9958-0bb655967d28" returned: 0 in 0.507s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:32 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-d71aa511-1536-4170-811e-db207aa745f0 tempest-SnapshotsActionsTest-1702071401 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.0633c5c4-b382-4c29-9958-0bb655967d28 is being set with open permissions: ugo+rw
Apr 02 10:27:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d71aa511-1536-4170-811e-db207aa745f0 tempest-SnapshotsActionsTest-1702071401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.0633c5c4-b382-4c29-9958-0bb655967d28 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:32 devstack sudo[85579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.0633c5c4-b382-4c29-9958-0bb655967d28
Apr 02 10:27:32 devstack sudo[85579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:32 devstack sudo[85579]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d71aa511-1536-4170-811e-db207aa745f0 tempest-SnapshotsActionsTest-1702071401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.0633c5c4-b382-4c29-9958-0bb655967d28" returned: 0 in 0.407s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d71aa511-1536-4170-811e-db207aa745f0 tempest-SnapshotsActionsTest-1702071401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.088s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:27:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-1a00ce9e-153a-4167-8141-4213a1ac24bf tempest-VolumesDeleteCascade-1697419128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.770s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:27:32 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-1a00ce9e-153a-4167-8141-4213a1ac24bf tempest-VolumesDeleteCascade-1697419128 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-633122035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39462c73-bdbd-4dae-8767-23efb0fcd9d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dce5c061482a48959f920570c813ecd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:27:30Z,use_quota=True,user_id='490c3c25edd94111b560f07aff989618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:27:32 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-1a00ce9e-153a-4167-8141-4213a1ac24bf tempest-VolumesDeleteCascade-1697419128 None] Creating volume 39462c73-bdbd-4dae-8767-23efb0fcd9d9 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:27:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-1a00ce9e-153a-4167-8141-4213a1ac24bf tempest-VolumesDeleteCascade-1697419128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:27:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-1a00ce9e-153a-4167-8141-4213a1ac24bf tempest-VolumesDeleteCascade-1697419128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:27:32 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-1a00ce9e-153a-4167-8141-4213a1ac24bf tempest-VolumesDeleteCascade-1697419128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:27:32 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-1a00ce9e-153a-4167-8141-4213a1ac24bf tempest-VolumesDeleteCascade-1697419128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:27:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-1a00ce9e-153a-4167-8141-4213a1ac24bf tempest-VolumesDeleteCascade-1697419128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:27:32 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-1a00ce9e-153a-4167-8141-4213a1ac24bf tempest-VolumesDeleteCascade-1697419128 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:27:32 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-1a00ce9e-153a-4167-8141-4213a1ac24bf tempest-VolumesDeleteCascade-1697419128 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:27:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1a00ce9e-153a-4167-8141-4213a1ac24bf tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:32 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-d71aa511-1536-4170-811e-db207aa745f0 tempest-SnapshotsActionsTest-1702071401 None] Create snapshot completed successfully
Apr 02 10:27:32 devstack sudo[85582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9 1073741824
Apr 02 10:27:32 devstack sudo[85582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:33 devstack sudo[85582]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1a00ce9e-153a-4167-8141-4213a1ac24bf tempest-VolumesDeleteCascade-1697419128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9 1073741824" returned: 0 in 0.539s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1a00ce9e-153a-4167-8141-4213a1ac24bf tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:33 devstack sudo[85587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9
Apr 02 10:27:33 devstack sudo[85587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:33 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-8dd52e0a-d671-46af-9cf1-9bde5fed7771 tempest-SnapshotsActionsTest-1402635934 None] Acquiring lock "cinder-0633c5c4-b382-4c29-9958-0bb655967d28-delete_snapshot" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:27:33 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-8dd52e0a-d671-46af-9cf1-9bde5fed7771 tempest-SnapshotsActionsTest-1402635934 None] Lock "cinder-0633c5c4-b382-4c29-9958-0bb655967d28-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:27:33 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-8dd52e0a-d671-46af-9cf1-9bde5fed7771 tempest-SnapshotsActionsTest-1402635934 None] Acquiring lock "cinder-quobyte-93162c96-8352-4cd5-a05e-f5a59c6083d5" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:27:33 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-8dd52e0a-d671-46af-9cf1-9bde5fed7771 tempest-SnapshotsActionsTest-1402635934 None] Lock "cinder-quobyte-93162c96-8352-4cd5-a05e-f5a59c6083d5" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:27:33 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-8dd52e0a-d671-46af-9cf1-9bde5fed7771 tempest-SnapshotsActionsTest-1402635934 None] Acquiring lock "cinder-quobyte-0633c5c4-b382-4c29-9958-0bb655967d28" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:27:33 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-8dd52e0a-d671-46af-9cf1-9bde5fed7771 tempest-SnapshotsActionsTest-1402635934 None] Lock "cinder-quobyte-0633c5c4-b382-4c29-9958-0bb655967d28" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:27:33 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-8dd52e0a-d671-46af-9cf1-9bde5fed7771 tempest-SnapshotsActionsTest-1402635934 None] Deleting offline snapshot 0633c5c4-b382-4c29-9958-0bb655967d28 of volume 93162c96-8352-4cd5-a05e-f5a59c6083d5 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:27:33 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-8dd52e0a-d671-46af-9cf1-9bde5fed7771 tempest-SnapshotsActionsTest-1402635934 None] snapshot_file for this snap is: volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.0633c5c4-b382-4c29-9958-0bb655967d28 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:27:33 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[688da5d3-f4fc-4515-a1e4-1e219e93944f]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8dd52e0a-d671-46af-9cf1-9bde5fed7771 tempest-SnapshotsActionsTest-1402635934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.0633c5c4-b382-4c29-9958-0bb655967d28 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:33 devstack sudo[85589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.0633c5c4-b382-4c29-9958-0bb655967d28
Apr 02 10:27:33 devstack sudo[85589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:33 devstack sudo[85587]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1a00ce9e-153a-4167-8141-4213a1ac24bf tempest-VolumesDeleteCascade-1697419128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9" returned: 0 in 0.431s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:33 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-1a00ce9e-153a-4167-8141-4213a1ac24bf tempest-VolumesDeleteCascade-1697419128 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:27:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-1a00ce9e-153a-4167-8141-4213a1ac24bf tempest-VolumesDeleteCascade-1697419128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:27:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-9350bfe1-4c37-4be6-a500-d5546223e43c req-0135757f-f151-4352-8e2b-0e51023eb528 tempest-VolumesSnapshotsTestJSON-1217673121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.628s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:27:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-1a00ce9e-153a-4167-8141-4213a1ac24bf tempest-VolumesDeleteCascade-1697419128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95074ec1-6de7-42a9-871a-45e32ff44f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-1a00ce9e-153a-4167-8141-4213a1ac24bf tempest-VolumesDeleteCascade-1697419128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4fb7c58-2a16-42e5-bbab-8bf522c22030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:33 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [req-9350bfe1-4c37-4be6-a500-d5546223e43c req-0135757f-f151-4352-8e2b-0e51023eb528 tempest-VolumesSnapshotsTestJSON-1217673121 None] Creating offline snapshot 6e083a01-2c8e-4e7a-a5b9-d6dfb7f30ef3 of volume 685c344f-1fce-410f-bce9-183af10a5c50 {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:27:33 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-1a00ce9e-153a-4167-8141-4213a1ac24bf tempest-VolumesDeleteCascade-1697419128 None] Volume volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9 (39462c73-bdbd-4dae-8767-23efb0fcd9d9): created successfully
Apr 02 10:27:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-1a00ce9e-153a-4167-8141-4213a1ac24bf tempest-VolumesDeleteCascade-1697419128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4fb7c58-2a16-42e5-bbab-8bf522c22030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-1a00ce9e-153a-4167-8141-4213a1ac24bf tempest-VolumesDeleteCascade-1697419128 None] Flow 'volume_create_manager' (f750a3b0-16d6-4847-b346-0bd55bff6ac9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:27:33 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71b5516-7265-4ed1-89f7-838c4c646eea]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-9350bfe1-4c37-4be6-a500-d5546223e43c req-0135757f-f151-4352-8e2b-0e51023eb528 tempest-VolumesSnapshotsTestJSON-1217673121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:33 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-1a00ce9e-153a-4167-8141-4213a1ac24bf tempest-VolumesDeleteCascade-1697419128 None] Created volume successfully.
Apr 02 10:27:33 devstack sudo[85592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50
Apr 02 10:27:33 devstack sudo[85592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:34 devstack sudo[85589]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8dd52e0a-d671-46af-9cf1-9bde5fed7771 tempest-SnapshotsActionsTest-1402635934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.0633c5c4-b382-4c29-9958-0bb655967d28" returned: 0 in 0.514s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:34 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-8dd52e0a-d671-46af-9cf1-9bde5fed7771 tempest-SnapshotsActionsTest-1402635934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93162c96-8352-4cd5-a05e-f5a59c6083d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:27:34 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1381243-ad6c-4317-bd01-cbc6a230a575]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8dd52e0a-d671-46af-9cf1-9bde5fed7771 tempest-SnapshotsActionsTest-1402635934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:34 devstack sudo[85600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48
Apr 02 10:27:34 devstack sudo[85600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-c8cfb746-d421-4786-acfb-1dfaa521e93b tempest-VolumesDeleteCascade-1697419128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:27:34 devstack sudo[85592]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-9350bfe1-4c37-4be6-a500-d5546223e43c req-0135757f-f151-4352-8e2b-0e51023eb528 tempest-VolumesSnapshotsTestJSON-1217673121 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50" returned: 0 in 0.569s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-9350bfe1-4c37-4be6-a500-d5546223e43c req-0135757f-f151-4352-8e2b-0e51023eb528 tempest-VolumesSnapshotsTestJSON-1217673121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50.6e083a01-2c8e-4e7a-a5b9-d6dfb7f30ef3 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:34 devstack sudo[85605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50.6e083a01-2c8e-4e7a-a5b9-d6dfb7f30ef3 1G
Apr 02 10:27:34 devstack sudo[85605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:34 devstack sudo[85600]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8dd52e0a-d671-46af-9cf1-9bde5fed7771 tempest-SnapshotsActionsTest-1402635934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48" returned: 0 in 0.566s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:34 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-8dd52e0a-d671-46af-9cf1-9bde5fed7771 tempest-SnapshotsActionsTest-1402635934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93162c96-8352-4cd5-a05e-f5a59c6083d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:27:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8dd52e0a-d671-46af-9cf1-9bde5fed7771 tempest-SnapshotsActionsTest-1402635934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.0633c5c4-b382-4c29-9958-0bb655967d28 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:34 devstack sudo[85610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.0633c5c4-b382-4c29-9958-0bb655967d28
Apr 02 10:27:34 devstack sudo[85610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:34 devstack sudo[85605]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-9350bfe1-4c37-4be6-a500-d5546223e43c req-0135757f-f151-4352-8e2b-0e51023eb528 tempest-VolumesSnapshotsTestJSON-1217673121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50.6e083a01-2c8e-4e7a-a5b9-d6dfb7f30ef3 1G" returned: 0 in 0.480s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-9350bfe1-4c37-4be6-a500-d5546223e43c req-0135757f-f151-4352-8e2b-0e51023eb528 tempest-VolumesSnapshotsTestJSON-1217673121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-685c344f-1fce-410f-bce9-183af10a5c50 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50.6e083a01-2c8e-4e7a-a5b9-d6dfb7f30ef3 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:34 devstack sudo[85615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-685c344f-1fce-410f-bce9-183af10a5c50 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50.6e083a01-2c8e-4e7a-a5b9-d6dfb7f30ef3
Apr 02 10:27:34 devstack sudo[85615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:35 devstack sudo[85610]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8dd52e0a-d671-46af-9cf1-9bde5fed7771 tempest-SnapshotsActionsTest-1402635934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.0633c5c4-b382-4c29-9958-0bb655967d28" returned: 0 in 0.508s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8dd52e0a-d671-46af-9cf1-9bde5fed7771 tempest-SnapshotsActionsTest-1402635934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.0633c5c4-b382-4c29-9958-0bb655967d28 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:35 devstack sudo[85620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.0633c5c4-b382-4c29-9958-0bb655967d28
Apr 02 10:27:35 devstack sudo[85620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:35 devstack sudo[85615]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-9350bfe1-4c37-4be6-a500-d5546223e43c req-0135757f-f151-4352-8e2b-0e51023eb528 tempest-VolumesSnapshotsTestJSON-1217673121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-685c344f-1fce-410f-bce9-183af10a5c50 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50.6e083a01-2c8e-4e7a-a5b9-d6dfb7f30ef3" returned: 0 in 0.472s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:35 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [req-9350bfe1-4c37-4be6-a500-d5546223e43c req-0135757f-f151-4352-8e2b-0e51023eb528 tempest-VolumesSnapshotsTestJSON-1217673121 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50.6e083a01-2c8e-4e7a-a5b9-d6dfb7f30ef3 is being set with open permissions: ugo+rw
Apr 02 10:27:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-9350bfe1-4c37-4be6-a500-d5546223e43c req-0135757f-f151-4352-8e2b-0e51023eb528 tempest-VolumesSnapshotsTestJSON-1217673121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50.6e083a01-2c8e-4e7a-a5b9-d6dfb7f30ef3 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:35 devstack sudo[85625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50.6e083a01-2c8e-4e7a-a5b9-d6dfb7f30ef3
Apr 02 10:27:35 devstack sudo[85625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:35 devstack sudo[85620]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8dd52e0a-d671-46af-9cf1-9bde5fed7771 tempest-SnapshotsActionsTest-1402635934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.0633c5c4-b382-4c29-9958-0bb655967d28" returned: 0 in 0.491s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:35 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-8dd52e0a-d671-46af-9cf1-9bde5fed7771 tempest-SnapshotsActionsTest-1402635934 None] Lock "cinder-quobyte-0633c5c4-b382-4c29-9958-0bb655967d28" released by "_delete_snapshot" :: held 2.132s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:27:35 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-8dd52e0a-d671-46af-9cf1-9bde5fed7771 tempest-SnapshotsActionsTest-1402635934 None] Lock "cinder-quobyte-93162c96-8352-4cd5-a05e-f5a59c6083d5" released by "delete_snapshot" :: held 2.144s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:27:35 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-8dd52e0a-d671-46af-9cf1-9bde5fed7771 tempest-SnapshotsActionsTest-1402635934 None] Created reservations ['1537b814-0f68-488a-ab73-927bfd1aa1ae', '245b24f5-6dbf-443f-9f7d-a752170969ba', 'f17a1e72-ddb6-4206-82cb-80cb4a9d0b56', 'be3cd403-8133-4b50-b071-b91651ef8d98'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:27:35 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-8dd52e0a-d671-46af-9cf1-9bde5fed7771 tempest-SnapshotsActionsTest-1402635934 None] Delete snapshot completed successfully.
Apr 02 10:27:35 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-8dd52e0a-d671-46af-9cf1-9bde5fed7771 tempest-SnapshotsActionsTest-1402635934 None] Lock "cinder-0633c5c4-b382-4c29-9958-0bb655967d28-delete_snapshot" released by "delete_snapshot" :: held 2.286s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:27:35 devstack sudo[85625]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-9350bfe1-4c37-4be6-a500-d5546223e43c req-0135757f-f151-4352-8e2b-0e51023eb528 tempest-VolumesSnapshotsTestJSON-1217673121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50.6e083a01-2c8e-4e7a-a5b9-d6dfb7f30ef3" returned: 0 in 0.555s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-9350bfe1-4c37-4be6-a500-d5546223e43c req-0135757f-f151-4352-8e2b-0e51023eb528 tempest-VolumesSnapshotsTestJSON-1217673121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:35 devstack sudo[85655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50.info
Apr 02 10:27:35 devstack sudo[85655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:36 devstack sudo[85655]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-9350bfe1-4c37-4be6-a500-d5546223e43c req-0135757f-f151-4352-8e2b-0e51023eb528 tempest-VolumesSnapshotsTestJSON-1217673121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50.info" returned: 0 in 0.458s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:36 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [req-9350bfe1-4c37-4be6-a500-d5546223e43c req-0135757f-f151-4352-8e2b-0e51023eb528 tempest-VolumesSnapshotsTestJSON-1217673121 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50.info is being set with open permissions: ugo+rw
Apr 02 10:27:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-9350bfe1-4c37-4be6-a500-d5546223e43c req-0135757f-f151-4352-8e2b-0e51023eb528 tempest-VolumesSnapshotsTestJSON-1217673121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:36 devstack sudo[85659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50.info
Apr 02 10:27:36 devstack sudo[85659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:36 devstack sudo[85659]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-9350bfe1-4c37-4be6-a500-d5546223e43c req-0135757f-f151-4352-8e2b-0e51023eb528 tempest-VolumesSnapshotsTestJSON-1217673121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50.info" returned: 0 in 0.563s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-9350bfe1-4c37-4be6-a500-d5546223e43c req-0135757f-f151-4352-8e2b-0e51023eb528 tempest-VolumesSnapshotsTestJSON-1217673121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.187s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:27:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-c8cfb746-d421-4786-acfb-1dfaa521e93b tempest-VolumesDeleteCascade-1697419128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.647s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:27:37 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-c8cfb746-d421-4786-acfb-1dfaa521e93b tempest-VolumesDeleteCascade-1697419128 None] Creating offline snapshot 6aab8b0c-b96c-4e4a-aef6-3d331f497fa3 of volume 39462c73-bdbd-4dae-8767-23efb0fcd9d9 {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:27:37 devstack cinder-volume[82102]: INFO cinder.volume.manager [req-9350bfe1-4c37-4be6-a500-d5546223e43c req-0135757f-f151-4352-8e2b-0e51023eb528 tempest-VolumesSnapshotsTestJSON-1217673121 None] Create snapshot completed successfully
Apr 02 10:27:37 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c283d7a-cf17-48f7-a3b2-885673dfbd2f]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c8cfb746-d421-4786-acfb-1dfaa521e93b tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-0daf00e2-113d-4ecd-a0bb-571e39380591 tempest-SnapshotsActionsTest-1702071401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:27:37 devstack sudo[85663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9
Apr 02 10:27:37 devstack sudo[85663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:37 devstack sudo[85663]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c8cfb746-d421-4786-acfb-1dfaa521e93b tempest-VolumesDeleteCascade-1697419128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9" returned: 0 in 0.510s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c8cfb746-d421-4786-acfb-1dfaa521e93b tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.6aab8b0c-b96c-4e4a-aef6-3d331f497fa3 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:37 devstack sudo[85668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.6aab8b0c-b96c-4e4a-aef6-3d331f497fa3 1G
Apr 02 10:27:37 devstack sudo[85668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:37 devstack cinder-volume[82102]: DEBUG cinder.coordination [req-e1830978-b6ab-452a-a2b2-fec88c0e413d req-a3613c45-e022-49d9-b764-236092aca51e tempest-VolumesSnapshotsTestJSON-1217673121 None] Acquiring lock "cinder-6e083a01-2c8e-4e7a-a5b9-d6dfb7f30ef3-delete_snapshot" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:27:37 devstack cinder-volume[82102]: DEBUG cinder.coordination [req-e1830978-b6ab-452a-a2b2-fec88c0e413d req-a3613c45-e022-49d9-b764-236092aca51e tempest-VolumesSnapshotsTestJSON-1217673121 None] Lock "cinder-6e083a01-2c8e-4e7a-a5b9-d6dfb7f30ef3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:27:37 devstack cinder-volume[82102]: DEBUG cinder.coordination [req-e1830978-b6ab-452a-a2b2-fec88c0e413d req-a3613c45-e022-49d9-b764-236092aca51e tempest-VolumesSnapshotsTestJSON-1217673121 None] Acquiring lock "cinder-quobyte-685c344f-1fce-410f-bce9-183af10a5c50" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:27:37 devstack cinder-volume[82102]: DEBUG cinder.coordination [req-e1830978-b6ab-452a-a2b2-fec88c0e413d req-a3613c45-e022-49d9-b764-236092aca51e tempest-VolumesSnapshotsTestJSON-1217673121 None] Lock "cinder-quobyte-685c344f-1fce-410f-bce9-183af10a5c50" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:27:37 devstack cinder-volume[82102]: DEBUG cinder.coordination [req-e1830978-b6ab-452a-a2b2-fec88c0e413d req-a3613c45-e022-49d9-b764-236092aca51e tempest-VolumesSnapshotsTestJSON-1217673121 None] Acquiring lock "cinder-quobyte-6e083a01-2c8e-4e7a-a5b9-d6dfb7f30ef3" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:27:37 devstack cinder-volume[82102]: DEBUG cinder.coordination [req-e1830978-b6ab-452a-a2b2-fec88c0e413d req-a3613c45-e022-49d9-b764-236092aca51e tempest-VolumesSnapshotsTestJSON-1217673121 None] Lock "cinder-quobyte-6e083a01-2c8e-4e7a-a5b9-d6dfb7f30ef3" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:27:37 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [req-e1830978-b6ab-452a-a2b2-fec88c0e413d req-a3613c45-e022-49d9-b764-236092aca51e tempest-VolumesSnapshotsTestJSON-1217673121 None] Deleting offline snapshot 6e083a01-2c8e-4e7a-a5b9-d6dfb7f30ef3 of volume 685c344f-1fce-410f-bce9-183af10a5c50 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:27:38 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [req-e1830978-b6ab-452a-a2b2-fec88c0e413d req-a3613c45-e022-49d9-b764-236092aca51e tempest-VolumesSnapshotsTestJSON-1217673121 None] snapshot_file for this snap is: volume-685c344f-1fce-410f-bce9-183af10a5c50.6e083a01-2c8e-4e7a-a5b9-d6dfb7f30ef3 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:27:38 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a29bf8a-c1d2-4184-b66c-d9b1381c9b93]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-e1830978-b6ab-452a-a2b2-fec88c0e413d req-a3613c45-e022-49d9-b764-236092aca51e tempest-VolumesSnapshotsTestJSON-1217673121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50.6e083a01-2c8e-4e7a-a5b9-d6dfb7f30ef3 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:38 devstack sudo[85673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50.6e083a01-2c8e-4e7a-a5b9-d6dfb7f30ef3
Apr 02 10:27:38 devstack sudo[85673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:38 devstack sudo[85668]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c8cfb746-d421-4786-acfb-1dfaa521e93b tempest-VolumesDeleteCascade-1697419128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.6aab8b0c-b96c-4e4a-aef6-3d331f497fa3 1G" returned: 0 in 0.578s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c8cfb746-d421-4786-acfb-1dfaa521e93b tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.6aab8b0c-b96c-4e4a-aef6-3d331f497fa3 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:38 devstack sudo[85675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.6aab8b0c-b96c-4e4a-aef6-3d331f497fa3
Apr 02 10:27:38 devstack sudo[85675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:38 devstack sudo[85673]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-e1830978-b6ab-452a-a2b2-fec88c0e413d req-a3613c45-e022-49d9-b764-236092aca51e tempest-VolumesSnapshotsTestJSON-1217673121 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50.6e083a01-2c8e-4e7a-a5b9-d6dfb7f30ef3" returned: 0 in 0.678s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:38 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [req-e1830978-b6ab-452a-a2b2-fec88c0e413d req-a3613c45-e022-49d9-b764-236092aca51e tempest-VolumesSnapshotsTestJSON-1217673121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-685c344f-1fce-410f-bce9-183af10a5c50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:27:38 devstack sudo[85675]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c8cfb746-d421-4786-acfb-1dfaa521e93b tempest-VolumesDeleteCascade-1697419128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.6aab8b0c-b96c-4e4a-aef6-3d331f497fa3" returned: 0 in 0.553s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:38 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-c8cfb746-d421-4786-acfb-1dfaa521e93b tempest-VolumesDeleteCascade-1697419128 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.6aab8b0c-b96c-4e4a-aef6-3d331f497fa3 is being set with open permissions: ugo+rw
Apr 02 10:27:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c8cfb746-d421-4786-acfb-1dfaa521e93b tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.6aab8b0c-b96c-4e4a-aef6-3d331f497fa3 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:38 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8a1725-3703-4399-8dd9-a1309d34466d]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-e1830978-b6ab-452a-a2b2-fec88c0e413d req-a3613c45-e022-49d9-b764-236092aca51e tempest-VolumesSnapshotsTestJSON-1217673121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:38 devstack sudo[85683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.6aab8b0c-b96c-4e4a-aef6-3d331f497fa3
Apr 02 10:27:38 devstack sudo[85683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:38 devstack sudo[85684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50
Apr 02 10:27:38 devstack sudo[85684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:39 devstack sudo[85683]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c8cfb746-d421-4786-acfb-1dfaa521e93b tempest-VolumesDeleteCascade-1697419128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.6aab8b0c-b96c-4e4a-aef6-3d331f497fa3" returned: 0 in 0.496s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c8cfb746-d421-4786-acfb-1dfaa521e93b tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:39 devstack sudo[85689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.info
Apr 02 10:27:39 devstack sudo[85689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:39 devstack sudo[85684]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-e1830978-b6ab-452a-a2b2-fec88c0e413d req-a3613c45-e022-49d9-b764-236092aca51e tempest-VolumesSnapshotsTestJSON-1217673121 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50" returned: 0 in 0.630s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-e1830978-b6ab-452a-a2b2-fec88c0e413d req-a3613c45-e022-49d9-b764-236092aca51e tempest-VolumesSnapshotsTestJSON-1217673121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50.6e083a01-2c8e-4e7a-a5b9-d6dfb7f30ef3 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:39 devstack sudo[85693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50.6e083a01-2c8e-4e7a-a5b9-d6dfb7f30ef3
Apr 02 10:27:39 devstack sudo[85693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:39 devstack sudo[85689]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c8cfb746-d421-4786-acfb-1dfaa521e93b tempest-VolumesDeleteCascade-1697419128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.info" returned: 0 in 0.444s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:39 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-c8cfb746-d421-4786-acfb-1dfaa521e93b tempest-VolumesDeleteCascade-1697419128 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.info is being set with open permissions: ugo+rw
Apr 02 10:27:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c8cfb746-d421-4786-acfb-1dfaa521e93b tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:39 devstack sudo[85696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.info
Apr 02 10:27:39 devstack sudo[85696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:39 devstack sudo[85693]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-e1830978-b6ab-452a-a2b2-fec88c0e413d req-a3613c45-e022-49d9-b764-236092aca51e tempest-VolumesSnapshotsTestJSON-1217673121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50.6e083a01-2c8e-4e7a-a5b9-d6dfb7f30ef3" returned: 0 in 0.511s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-e1830978-b6ab-452a-a2b2-fec88c0e413d req-a3613c45-e022-49d9-b764-236092aca51e tempest-VolumesSnapshotsTestJSON-1217673121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50.6e083a01-2c8e-4e7a-a5b9-d6dfb7f30ef3 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:39 devstack sudo[85701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50.6e083a01-2c8e-4e7a-a5b9-d6dfb7f30ef3
Apr 02 10:27:39 devstack sudo[85701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:40 devstack sudo[85696]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c8cfb746-d421-4786-acfb-1dfaa521e93b tempest-VolumesDeleteCascade-1697419128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.info" returned: 0 in 0.566s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-c8cfb746-d421-4786-acfb-1dfaa521e93b tempest-VolumesDeleteCascade-1697419128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.287s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:27:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-0daf00e2-113d-4ecd-a0bb-571e39380591 tempest-SnapshotsActionsTest-1702071401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.205s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:27:40 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-0daf00e2-113d-4ecd-a0bb-571e39380591 tempest-SnapshotsActionsTest-1702071401 None] Creating offline snapshot cb56b1f0-d1b4-4a28-845f-5dd825308c5e of volume 93162c96-8352-4cd5-a05e-f5a59c6083d5 {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:27:40 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc053b44-80ec-4912-91d9-f31070b1582c]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0daf00e2-113d-4ecd-a0bb-571e39380591 tempest-SnapshotsActionsTest-1702071401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:40 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-c8cfb746-d421-4786-acfb-1dfaa521e93b tempest-VolumesDeleteCascade-1697419128 None] Create snapshot completed successfully
Apr 02 10:27:40 devstack sudo[85701]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-e1830978-b6ab-452a-a2b2-fec88c0e413d req-a3613c45-e022-49d9-b764-236092aca51e tempest-VolumesSnapshotsTestJSON-1217673121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50.6e083a01-2c8e-4e7a-a5b9-d6dfb7f30ef3" returned: 0 in 0.569s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:40 devstack sudo[85705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48
Apr 02 10:27:40 devstack sudo[85705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:40 devstack cinder-volume[82102]: DEBUG cinder.coordination [req-e1830978-b6ab-452a-a2b2-fec88c0e413d req-a3613c45-e022-49d9-b764-236092aca51e tempest-VolumesSnapshotsTestJSON-1217673121 None] Lock "cinder-quobyte-6e083a01-2c8e-4e7a-a5b9-d6dfb7f30ef3" released by "_delete_snapshot" :: held 2.478s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:27:40 devstack cinder-volume[82102]: DEBUG cinder.coordination [req-e1830978-b6ab-452a-a2b2-fec88c0e413d req-a3613c45-e022-49d9-b764-236092aca51e tempest-VolumesSnapshotsTestJSON-1217673121 None] Lock "cinder-quobyte-685c344f-1fce-410f-bce9-183af10a5c50" released by "delete_snapshot" :: held 2.490s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:27:40 devstack cinder-volume[82102]: DEBUG cinder.quota [req-e1830978-b6ab-452a-a2b2-fec88c0e413d req-a3613c45-e022-49d9-b764-236092aca51e tempest-VolumesSnapshotsTestJSON-1217673121 None] Created reservations ['51729226-3b80-491a-b520-ad70c4106da8', '3cc756fd-ec6a-44bf-8922-2ec39d8272a0', 'ccccddd9-15b6-4ce0-8290-63ca2d7377ef', '5bd02585-1f5a-4d9f-81f6-4dfd0f4458ed'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:27:40 devstack cinder-volume[82102]: INFO cinder.volume.manager [req-e1830978-b6ab-452a-a2b2-fec88c0e413d req-a3613c45-e022-49d9-b764-236092aca51e tempest-VolumesSnapshotsTestJSON-1217673121 None] Delete snapshot completed successfully.
Apr 02 10:27:40 devstack cinder-volume[82102]: DEBUG cinder.coordination [req-e1830978-b6ab-452a-a2b2-fec88c0e413d req-a3613c45-e022-49d9-b764-236092aca51e tempest-VolumesSnapshotsTestJSON-1217673121 None] Lock "cinder-6e083a01-2c8e-4e7a-a5b9-d6dfb7f30ef3-delete_snapshot" released by "delete_snapshot" :: held 2.577s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:27:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-24ccb8ea-c164-4f09-809c-8a0c24d49fb4 tempest-VolumesDeleteCascade-1697419128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:27:40 devstack sudo[85705]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0daf00e2-113d-4ecd-a0bb-571e39380591 tempest-SnapshotsActionsTest-1702071401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48" returned: 0 in 0.574s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:40 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-0daf00e2-113d-4ecd-a0bb-571e39380591 tempest-SnapshotsActionsTest-1702071401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93162c96-8352-4cd5-a05e-f5a59c6083d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:27:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0daf00e2-113d-4ecd-a0bb-571e39380591 tempest-SnapshotsActionsTest-1702071401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.cb56b1f0-d1b4-4a28-845f-5dd825308c5e 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:40 devstack sudo[85717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.cb56b1f0-d1b4-4a28-845f-5dd825308c5e 1G
Apr 02 10:27:40 devstack sudo[85717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:41 devstack cinder-volume[82102]: DEBUG cinder.coordination [req-b9f40ee1-c091-4aa2-9338-7e446bbedd7c req-b089ff59-b7e8-4f64-8b3a-9d6e2237fc78 tempest-VolumesSnapshotsTestJSON-1217673121 None] Acquiring lock "cinder-685c344f-1fce-410f-bce9-183af10a5c50-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:27:41 devstack cinder-volume[82102]: DEBUG cinder.coordination [req-b9f40ee1-c091-4aa2-9338-7e446bbedd7c req-b089ff59-b7e8-4f64-8b3a-9d6e2237fc78 tempest-VolumesSnapshotsTestJSON-1217673121 None] Lock "cinder-685c344f-1fce-410f-bce9-183af10a5c50-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:27:41 devstack cinder-volume[82102]: DEBUG cinder.coordination [req-b9f40ee1-c091-4aa2-9338-7e446bbedd7c req-b089ff59-b7e8-4f64-8b3a-9d6e2237fc78 tempest-VolumesSnapshotsTestJSON-1217673121 None] Acquiring lock "cinder-quobyte-685c344f-1fce-410f-bce9-183af10a5c50" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:27:41 devstack cinder-volume[82102]: DEBUG cinder.coordination [req-b9f40ee1-c091-4aa2-9338-7e446bbedd7c req-b089ff59-b7e8-4f64-8b3a-9d6e2237fc78 tempest-VolumesSnapshotsTestJSON-1217673121 None] Lock "cinder-quobyte-685c344f-1fce-410f-bce9-183af10a5c50" acquired by "delete_volume" :: waited 0.013s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:27:41 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5938b16-1473-43b6-b437-d6ef4ec24911]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-b9f40ee1-c091-4aa2-9338-7e446bbedd7c req-b089ff59-b7e8-4f64-8b3a-9d6e2237fc78 tempest-VolumesSnapshotsTestJSON-1217673121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:41 devstack sudo[85722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50
Apr 02 10:27:41 devstack sudo[85722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:41 devstack sudo[85717]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0daf00e2-113d-4ecd-a0bb-571e39380591 tempest-SnapshotsActionsTest-1702071401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.cb56b1f0-d1b4-4a28-845f-5dd825308c5e 1G" returned: 0 in 0.588s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0daf00e2-113d-4ecd-a0bb-571e39380591 tempest-SnapshotsActionsTest-1702071401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.cb56b1f0-d1b4-4a28-845f-5dd825308c5e {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:41 devstack sudo[85724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.cb56b1f0-d1b4-4a28-845f-5dd825308c5e
Apr 02 10:27:41 devstack sudo[85724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:41 devstack sudo[85722]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-b9f40ee1-c091-4aa2-9338-7e446bbedd7c req-b089ff59-b7e8-4f64-8b3a-9d6e2237fc78 tempest-VolumesSnapshotsTestJSON-1217673121 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50" returned: 0 in 0.511s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-b9f40ee1-c091-4aa2-9338-7e446bbedd7c req-b089ff59-b7e8-4f64-8b3a-9d6e2237fc78 tempest-VolumesSnapshotsTestJSON-1217673121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:41 devstack sudo[85724]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:41 devstack sudo[85732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50
Apr 02 10:27:41 devstack sudo[85732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0daf00e2-113d-4ecd-a0bb-571e39380591 tempest-SnapshotsActionsTest-1702071401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.cb56b1f0-d1b4-4a28-845f-5dd825308c5e" returned: 0 in 0.461s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:41 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-0daf00e2-113d-4ecd-a0bb-571e39380591 tempest-SnapshotsActionsTest-1702071401 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.cb56b1f0-d1b4-4a28-845f-5dd825308c5e is being set with open permissions: ugo+rw
Apr 02 10:27:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0daf00e2-113d-4ecd-a0bb-571e39380591 tempest-SnapshotsActionsTest-1702071401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.cb56b1f0-d1b4-4a28-845f-5dd825308c5e {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:42 devstack sudo[85734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.cb56b1f0-d1b4-4a28-845f-5dd825308c5e
Apr 02 10:27:42 devstack sudo[85734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:42 devstack sudo[85734]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0daf00e2-113d-4ecd-a0bb-571e39380591 tempest-SnapshotsActionsTest-1702071401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.cb56b1f0-d1b4-4a28-845f-5dd825308c5e" returned: 0 in 0.414s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-0daf00e2-113d-4ecd-a0bb-571e39380591 tempest-SnapshotsActionsTest-1702071401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.123s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:27:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-24ccb8ea-c164-4f09-809c-8a0c24d49fb4 tempest-VolumesDeleteCascade-1697419128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.678s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:27:42 devstack sudo[85732]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:42 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-24ccb8ea-c164-4f09-809c-8a0c24d49fb4 tempest-VolumesDeleteCascade-1697419128 None] Creating offline snapshot f688cc04-6a2b-4ebf-a08a-28be89485327 of volume 39462c73-bdbd-4dae-8767-23efb0fcd9d9 {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:27:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-b9f40ee1-c091-4aa2-9338-7e446bbedd7c req-b089ff59-b7e8-4f64-8b3a-9d6e2237fc78 tempest-VolumesSnapshotsTestJSON-1217673121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-685c344f-1fce-410f-bce9-183af10a5c50" returned: 0 in 0.571s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:42 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[414a0b9c-b569-4a54-b4d6-5697b08bb106]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-24ccb8ea-c164-4f09-809c-8a0c24d49fb4 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.6aab8b0c-b96c-4e4a-aef6-3d331f497fa3 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:42 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-0daf00e2-113d-4ecd-a0bb-571e39380591 tempest-SnapshotsActionsTest-1702071401 None] Create snapshot completed successfully
Apr 02 10:27:42 devstack cinder-volume[82102]: DEBUG cinder.coordination [req-b9f40ee1-c091-4aa2-9338-7e446bbedd7c req-b089ff59-b7e8-4f64-8b3a-9d6e2237fc78 tempest-VolumesSnapshotsTestJSON-1217673121 None] Lock "cinder-quobyte-685c344f-1fce-410f-bce9-183af10a5c50" released by "delete_volume" :: held 1.145s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:27:42 devstack cinder-volume[82102]: DEBUG cinder.quota [req-b9f40ee1-c091-4aa2-9338-7e446bbedd7c req-b089ff59-b7e8-4f64-8b3a-9d6e2237fc78 tempest-VolumesSnapshotsTestJSON-1217673121 None] Created reservations ['d7ad517b-d7eb-4410-9110-e8990137dead', '64f45c37-baba-4ebe-9019-b2fc88789109', '297762dc-f00c-4d7d-ab34-afedeead2d16', '60d912dc-cc92-4284-b8fd-bb627f4ceb10'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:27:42 devstack sudo[85744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.6aab8b0c-b96c-4e4a-aef6-3d331f497fa3
Apr 02 10:27:42 devstack sudo[85744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-b9f40ee1-c091-4aa2-9338-7e446bbedd7c req-b089ff59-b7e8-4f64-8b3a-9d6e2237fc78 tempest-VolumesSnapshotsTestJSON-1217673121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:27:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-b9f40ee1-c091-4aa2-9338-7e446bbedd7c req-b089ff59-b7e8-4f64-8b3a-9d6e2237fc78 tempest-VolumesSnapshotsTestJSON-1217673121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:27:42 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [req-b9f40ee1-c091-4aa2-9338-7e446bbedd7c req-b089ff59-b7e8-4f64-8b3a-9d6e2237fc78 tempest-VolumesSnapshotsTestJSON-1217673121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:27:42 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [req-b9f40ee1-c091-4aa2-9338-7e446bbedd7c req-b089ff59-b7e8-4f64-8b3a-9d6e2237fc78 tempest-VolumesSnapshotsTestJSON-1217673121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:27:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-b9f40ee1-c091-4aa2-9338-7e446bbedd7c req-b089ff59-b7e8-4f64-8b3a-9d6e2237fc78 tempest-VolumesSnapshotsTestJSON-1217673121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:27:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-b9f40ee1-c091-4aa2-9338-7e446bbedd7c req-b089ff59-b7e8-4f64-8b3a-9d6e2237fc78 tempest-VolumesSnapshotsTestJSON-1217673121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:42 devstack sudo[85761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:27:42 devstack sudo[85761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:43 devstack sudo[85744]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-24ccb8ea-c164-4f09-809c-8a0c24d49fb4 tempest-VolumesDeleteCascade-1697419128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.6aab8b0c-b96c-4e4a-aef6-3d331f497fa3" returned: 0 in 0.590s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:43 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-24ccb8ea-c164-4f09-809c-8a0c24d49fb4 tempest-VolumesDeleteCascade-1697419128 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:27:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-24ccb8ea-c164-4f09-809c-8a0c24d49fb4 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.6aab8b0c-b96c-4e4a-aef6-3d331f497fa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.f688cc04-6a2b-4ebf-a08a-28be89485327 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:43 devstack sudo[85767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.6aab8b0c-b96c-4e4a-aef6-3d331f497fa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.f688cc04-6a2b-4ebf-a08a-28be89485327 1G
Apr 02 10:27:43 devstack sudo[85767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:43 devstack sudo[85761]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-b9f40ee1-c091-4aa2-9338-7e446bbedd7c req-b089ff59-b7e8-4f64-8b3a-9d6e2237fc78 tempest-VolumesSnapshotsTestJSON-1217673121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.526s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:43 devstack cinder-volume[82102]: DEBUG cinder.manager [req-b9f40ee1-c091-4aa2-9338-7e446bbedd7c req-b089ff59-b7e8-4f64-8b3a-9d6e2237fc78 tempest-VolumesSnapshotsTestJSON-1217673121 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:27:43 devstack cinder-volume[82102]: INFO cinder.volume.manager [req-b9f40ee1-c091-4aa2-9338-7e446bbedd7c req-b089ff59-b7e8-4f64-8b3a-9d6e2237fc78 tempest-VolumesSnapshotsTestJSON-1217673121 None] Deleted volume successfully.
Apr 02 10:27:43 devstack cinder-volume[82102]: DEBUG cinder.coordination [req-b9f40ee1-c091-4aa2-9338-7e446bbedd7c req-b089ff59-b7e8-4f64-8b3a-9d6e2237fc78 tempest-VolumesSnapshotsTestJSON-1217673121 None] Lock "cinder-685c344f-1fce-410f-bce9-183af10a5c50-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:27:43 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-64d46cee-8570-49b4-9d1a-4ce7ed1d66ea tempest-SnapshotsActionsTest-1402635934 None] Acquiring lock "cinder-cb56b1f0-d1b4-4a28-845f-5dd825308c5e-delete_snapshot" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:27:43 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-64d46cee-8570-49b4-9d1a-4ce7ed1d66ea tempest-SnapshotsActionsTest-1402635934 None] Lock "cinder-cb56b1f0-d1b4-4a28-845f-5dd825308c5e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:27:43 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-64d46cee-8570-49b4-9d1a-4ce7ed1d66ea tempest-SnapshotsActionsTest-1402635934 None] Acquiring lock "cinder-quobyte-93162c96-8352-4cd5-a05e-f5a59c6083d5" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:27:43 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-64d46cee-8570-49b4-9d1a-4ce7ed1d66ea tempest-SnapshotsActionsTest-1402635934 None] Lock "cinder-quobyte-93162c96-8352-4cd5-a05e-f5a59c6083d5" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:27:43 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-64d46cee-8570-49b4-9d1a-4ce7ed1d66ea tempest-SnapshotsActionsTest-1402635934 None] Acquiring lock "cinder-quobyte-cb56b1f0-d1b4-4a28-845f-5dd825308c5e" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:27:43 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-64d46cee-8570-49b4-9d1a-4ce7ed1d66ea tempest-SnapshotsActionsTest-1402635934 None] Lock "cinder-quobyte-cb56b1f0-d1b4-4a28-845f-5dd825308c5e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:27:43 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-64d46cee-8570-49b4-9d1a-4ce7ed1d66ea tempest-SnapshotsActionsTest-1402635934 None] Deleting offline snapshot cb56b1f0-d1b4-4a28-845f-5dd825308c5e of volume 93162c96-8352-4cd5-a05e-f5a59c6083d5 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:27:43 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-64d46cee-8570-49b4-9d1a-4ce7ed1d66ea tempest-SnapshotsActionsTest-1402635934 None] snapshot_file for this snap is: volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.cb56b1f0-d1b4-4a28-845f-5dd825308c5e {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:27:43 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c793c4bf-6305-470b-ba52-c86626d01650]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-64d46cee-8570-49b4-9d1a-4ce7ed1d66ea tempest-SnapshotsActionsTest-1402635934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.cb56b1f0-d1b4-4a28-845f-5dd825308c5e {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:43 devstack sudo[85772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.cb56b1f0-d1b4-4a28-845f-5dd825308c5e
Apr 02 10:27:43 devstack sudo[85772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:43 devstack sudo[85767]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-24ccb8ea-c164-4f09-809c-8a0c24d49fb4 tempest-VolumesDeleteCascade-1697419128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.6aab8b0c-b96c-4e4a-aef6-3d331f497fa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.f688cc04-6a2b-4ebf-a08a-28be89485327 1G" returned: 0 in 0.568s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-24ccb8ea-c164-4f09-809c-8a0c24d49fb4 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.6aab8b0c-b96c-4e4a-aef6-3d331f497fa3 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.f688cc04-6a2b-4ebf-a08a-28be89485327 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:43 devstack sudo[85775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.6aab8b0c-b96c-4e4a-aef6-3d331f497fa3 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.f688cc04-6a2b-4ebf-a08a-28be89485327
Apr 02 10:27:43 devstack sudo[85775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:44 devstack sudo[85772]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:44 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-64d46cee-8570-49b4-9d1a-4ce7ed1d66ea tempest-SnapshotsActionsTest-1402635934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.cb56b1f0-d1b4-4a28-845f-5dd825308c5e" returned: 0 in 0.579s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:44 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-64d46cee-8570-49b4-9d1a-4ce7ed1d66ea tempest-SnapshotsActionsTest-1402635934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93162c96-8352-4cd5-a05e-f5a59c6083d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:27:44 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c0a981-8325-40fd-990f-a32eae5f97d3]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:44 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-64d46cee-8570-49b4-9d1a-4ce7ed1d66ea tempest-SnapshotsActionsTest-1402635934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:44 devstack sudo[85782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48
Apr 02 10:27:44 devstack sudo[85782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:44 devstack sudo[85775]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:44 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-24ccb8ea-c164-4f09-809c-8a0c24d49fb4 tempest-VolumesDeleteCascade-1697419128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.6aab8b0c-b96c-4e4a-aef6-3d331f497fa3 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.f688cc04-6a2b-4ebf-a08a-28be89485327" returned: 0 in 0.554s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:44 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-24ccb8ea-c164-4f09-809c-8a0c24d49fb4 tempest-VolumesDeleteCascade-1697419128 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.f688cc04-6a2b-4ebf-a08a-28be89485327 is being set with open permissions: ugo+rw
Apr 02 10:27:44 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-24ccb8ea-c164-4f09-809c-8a0c24d49fb4 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.f688cc04-6a2b-4ebf-a08a-28be89485327 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:44 devstack sudo[85786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.f688cc04-6a2b-4ebf-a08a-28be89485327
Apr 02 10:27:44 devstack sudo[85786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:44 devstack sudo[85782]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:44 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-64d46cee-8570-49b4-9d1a-4ce7ed1d66ea tempest-SnapshotsActionsTest-1402635934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48" returned: 0 in 0.559s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:44 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-64d46cee-8570-49b4-9d1a-4ce7ed1d66ea tempest-SnapshotsActionsTest-1402635934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93162c96-8352-4cd5-a05e-f5a59c6083d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:27:44 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-64d46cee-8570-49b4-9d1a-4ce7ed1d66ea tempest-SnapshotsActionsTest-1402635934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.cb56b1f0-d1b4-4a28-845f-5dd825308c5e {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:44 devstack sudo[85805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.cb56b1f0-d1b4-4a28-845f-5dd825308c5e
Apr 02 10:27:44 devstack sudo[85805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:44 devstack sudo[85786]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:44 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-24ccb8ea-c164-4f09-809c-8a0c24d49fb4 tempest-VolumesDeleteCascade-1697419128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.f688cc04-6a2b-4ebf-a08a-28be89485327" returned: 0 in 0.616s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:44 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-24ccb8ea-c164-4f09-809c-8a0c24d49fb4 tempest-VolumesDeleteCascade-1697419128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.460s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:27:44 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-24ccb8ea-c164-4f09-809c-8a0c24d49fb4 tempest-VolumesDeleteCascade-1697419128 None] Create snapshot completed successfully
Apr 02 10:27:45 devstack sudo[85805]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-64d46cee-8570-49b4-9d1a-4ce7ed1d66ea tempest-SnapshotsActionsTest-1402635934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.cb56b1f0-d1b4-4a28-845f-5dd825308c5e" returned: 0 in 0.532s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-64d46cee-8570-49b4-9d1a-4ce7ed1d66ea tempest-SnapshotsActionsTest-1402635934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.cb56b1f0-d1b4-4a28-845f-5dd825308c5e {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:45 devstack sudo[85817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.cb56b1f0-d1b4-4a28-845f-5dd825308c5e
Apr 02 10:27:45 devstack sudo[85817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:45 devstack sudo[85817]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-64d46cee-8570-49b4-9d1a-4ce7ed1d66ea tempest-SnapshotsActionsTest-1402635934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.cb56b1f0-d1b4-4a28-845f-5dd825308c5e" returned: 0 in 0.453s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:45 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-64d46cee-8570-49b4-9d1a-4ce7ed1d66ea tempest-SnapshotsActionsTest-1402635934 None] Lock "cinder-quobyte-cb56b1f0-d1b4-4a28-845f-5dd825308c5e" released by "_delete_snapshot" :: held 2.185s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:27:45 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-64d46cee-8570-49b4-9d1a-4ce7ed1d66ea tempest-SnapshotsActionsTest-1402635934 None] Lock "cinder-quobyte-93162c96-8352-4cd5-a05e-f5a59c6083d5" released by "delete_snapshot" :: held 2.208s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:27:45 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-64d46cee-8570-49b4-9d1a-4ce7ed1d66ea tempest-SnapshotsActionsTest-1402635934 None] Created reservations ['e60e1158-4bb0-4eca-ac85-8fb0aad9337f', 'fdda5c09-9bb5-432f-863b-a0f7bb4bdc87', '449413e4-5a24-4d8b-b151-b1370fe49d45', '281c03c9-a825-40ca-bd67-dddedc40a31c'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:27:45 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-64d46cee-8570-49b4-9d1a-4ce7ed1d66ea tempest-SnapshotsActionsTest-1402635934 None] Delete snapshot completed successfully.
Apr 02 10:27:45 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-64d46cee-8570-49b4-9d1a-4ce7ed1d66ea tempest-SnapshotsActionsTest-1402635934 None] Lock "cinder-cb56b1f0-d1b4-4a28-845f-5dd825308c5e-delete_snapshot" released by "delete_snapshot" :: held 2.316s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:27:46 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Acquiring lock "cinder-39462c73-bdbd-4dae-8767-23efb0fcd9d9-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:27:46 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Lock "cinder-39462c73-bdbd-4dae-8767-23efb0fcd9d9-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:27:46 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Performing cascade delete. {{(pid=82102) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 02 10:27:46 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Acquiring lock "cinder-6aab8b0c-b96c-4e4a-aef6-3d331f497fa3-delete_snapshot" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:27:46 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Lock "cinder-6aab8b0c-b96c-4e4a-aef6-3d331f497fa3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:27:46 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Acquiring lock "cinder-quobyte-39462c73-bdbd-4dae-8767-23efb0fcd9d9" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:27:46 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Lock "cinder-quobyte-39462c73-bdbd-4dae-8767-23efb0fcd9d9" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:27:46 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Acquiring lock "cinder-quobyte-6aab8b0c-b96c-4e4a-aef6-3d331f497fa3" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:27:46 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Lock "cinder-quobyte-6aab8b0c-b96c-4e4a-aef6-3d331f497fa3" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:27:46 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Deleting offline snapshot 6aab8b0c-b96c-4e4a-aef6-3d331f497fa3 of volume 39462c73-bdbd-4dae-8767-23efb0fcd9d9 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:27:46 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] snapshot_file for this snap is: volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.6aab8b0c-b96c-4e4a-aef6-3d331f497fa3 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:27:46 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[544e03b6-8eec-4082-a9ed-59e26a6cbd71]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:46 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.6aab8b0c-b96c-4e4a-aef6-3d331f497fa3 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:46 devstack sudo[85820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.6aab8b0c-b96c-4e4a-aef6-3d331f497fa3
Apr 02 10:27:46 devstack sudo[85820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:46 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-c4a1001b-8457-4c9b-a794-7caa851f581b tempest-GroupsV314Test-677498788 None] Group tempest-GroupsV314Test-Group-1204720253: creating
Apr 02 10:27:46 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-c4a1001b-8457-4c9b-a794-7caa851f581b tempest-GroupsV314Test-677498788 None] Group tempest-GroupsV314Test-Group-1204720253: created successfully
Apr 02 10:27:46 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-c4a1001b-8457-4c9b-a794-7caa851f581b tempest-GroupsV314Test-677498788 None] Create group completed successfully.
Apr 02 10:27:46 devstack sudo[85820]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:46 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.6aab8b0c-b96c-4e4a-aef6-3d331f497fa3" returned: 0 in 0.626s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:46 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:27:46 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[85066108-2c8a-4287-bebf-507a7aafb003]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:46 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:46 devstack sudo[85857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9
Apr 02 10:27:46 devstack sudo[85857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:46 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a4bdb429-ebb8-4db8-aa68-458f46b11df6 tempest-SnapshotsActionsTest-1702071401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:27:46 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a4bdb429-ebb8-4db8-aa68-458f46b11df6 tempest-SnapshotsActionsTest-1702071401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:27:46 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-a4bdb429-ebb8-4db8-aa68-458f46b11df6 tempest-SnapshotsActionsTest-1702071401 None] Creating offline snapshot 32a591ff-65cf-4cd2-8149-7bca16eceefe of volume 93162c96-8352-4cd5-a05e-f5a59c6083d5 {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:27:46 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1b23c3-5ccc-4fd7-b3c5-59c5e7ca723b]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:46 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a4bdb429-ebb8-4db8-aa68-458f46b11df6 tempest-SnapshotsActionsTest-1702071401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:46 devstack sudo[85861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48
Apr 02 10:27:46 devstack sudo[85861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:47 devstack sudo[85857]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9" returned: 0 in 0.475s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:47 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[87522083-65e0-47a8-9930-d19f9463587b]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.f688cc04-6a2b-4ebf-a08a-28be89485327 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:47 devstack sudo[85866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.f688cc04-6a2b-4ebf-a08a-28be89485327
Apr 02 10:27:47 devstack sudo[85866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:47 devstack sudo[85861]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a4bdb429-ebb8-4db8-aa68-458f46b11df6 tempest-SnapshotsActionsTest-1702071401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48" returned: 0 in 0.480s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:47 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-a4bdb429-ebb8-4db8-aa68-458f46b11df6 tempest-SnapshotsActionsTest-1702071401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93162c96-8352-4cd5-a05e-f5a59c6083d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:27:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a4bdb429-ebb8-4db8-aa68-458f46b11df6 tempest-SnapshotsActionsTest-1702071401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.32a591ff-65cf-4cd2-8149-7bca16eceefe 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:47 devstack sudo[85871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.32a591ff-65cf-4cd2-8149-7bca16eceefe 1G
Apr 02 10:27:47 devstack sudo[85871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:47 devstack sudo[85866]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.f688cc04-6a2b-4ebf-a08a-28be89485327" returned: 0 in 0.606s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:47 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:27:47 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd15ec5-b1c7-4a56-989f-4df143dd3c90]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.6aab8b0c-b96c-4e4a-aef6-3d331f497fa3 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:47 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-f249a5e9-0e5f-408c-b2e1-9d8d441db71e tempest-GroupsV314Test-677498788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:27:47 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f249a5e9-0e5f-408c-b2e1-9d8d441db71e tempest-GroupsV314Test-677498788 None] Flow 'volume_create_manager' (cd33188f-15e2-4dbc-989b-f282924f2472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:27:47 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f249a5e9-0e5f-408c-b2e1-9d8d441db71e tempest-GroupsV314Test-677498788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5101210d-203c-4f55-8e80-23171c4d0245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:47 devstack sudo[85879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.6aab8b0c-b96c-4e4a-aef6-3d331f497fa3
Apr 02 10:27:47 devstack sudo[85879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:47 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f249a5e9-0e5f-408c-b2e1-9d8d441db71e tempest-GroupsV314Test-677498788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5101210d-203c-4f55-8e80-23171c4d0245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1537227796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8d8317cf-493a-4b44-bbd8-3ba7c127c839,host='devstack@QuobyteHD#QuobyteHD',id=6748b06e-96b4-43a4-920e-6c1981a600f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3382549129fd4df4b399e87b4a460ff4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:27:48Z,use_quota=True,user_id='ab14a4fcbc514188a0430852fa45069f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3008d1e9-dc6f-41a2-be01-7efcf5a19e0c),volume_type_id=3008d1e9-dc6f-41a2-be01-7efcf5a19e0c)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f249a5e9-0e5f-408c-b2e1-9d8d441db71e tempest-GroupsV314Test-677498788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7752723d-f102-431f-be88-29a820571e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f249a5e9-0e5f-408c-b2e1-9d8d441db71e tempest-GroupsV314Test-677498788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7752723d-f102-431f-be88-29a820571e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f249a5e9-0e5f-408c-b2e1-9d8d441db71e tempest-GroupsV314Test-677498788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07e43e0c-8993-4ce4-b5fd-73b527df762e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:48 devstack sudo[85871]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f249a5e9-0e5f-408c-b2e1-9d8d441db71e tempest-GroupsV314Test-677498788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07e43e0c-8993-4ce4-b5fd-73b527df762e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6748b06e-96b4-43a4-920e-6c1981a600f4', 'volume_name': 'volume-6748b06e-96b4-43a4-920e-6c1981a600f4', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f249a5e9-0e5f-408c-b2e1-9d8d441db71e tempest-GroupsV314Test-677498788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c24949b8-a260-45fe-ad36-a01f5531fbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f249a5e9-0e5f-408c-b2e1-9d8d441db71e tempest-GroupsV314Test-677498788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c24949b8-a260-45fe-ad36-a01f5531fbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f249a5e9-0e5f-408c-b2e1-9d8d441db71e tempest-GroupsV314Test-677498788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf623c7d-1791-401d-9dcc-a44fa9fa1870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:48 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-f249a5e9-0e5f-408c-b2e1-9d8d441db71e tempest-GroupsV314Test-677498788 None] Volume 6748b06e-96b4-43a4-920e-6c1981a600f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6748b06e-96b4-43a4-920e-6c1981a600f4', 'volume_size': 1}
Apr 02 10:27:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f249a5e9-0e5f-408c-b2e1-9d8d441db71e tempest-GroupsV314Test-677498788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:27:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a4bdb429-ebb8-4db8-aa68-458f46b11df6 tempest-SnapshotsActionsTest-1702071401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.32a591ff-65cf-4cd2-8149-7bca16eceefe 1G" returned: 0 in 0.653s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a4bdb429-ebb8-4db8-aa68-458f46b11df6 tempest-SnapshotsActionsTest-1702071401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.32a591ff-65cf-4cd2-8149-7bca16eceefe {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:48 devstack sudo[85881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.32a591ff-65cf-4cd2-8149-7bca16eceefe
Apr 02 10:27:48 devstack sudo[85881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:48 devstack sudo[85879]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.6aab8b0c-b96c-4e4a-aef6-3d331f497fa3" returned: 0 in 0.491s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:48 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:27:48 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16fe04a-7175-4db3-9d9c-bd1fed57e369]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:48 devstack sudo[85889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9
Apr 02 10:27:48 devstack sudo[85889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:48 devstack sudo[85881]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a4bdb429-ebb8-4db8-aa68-458f46b11df6 tempest-SnapshotsActionsTest-1702071401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.32a591ff-65cf-4cd2-8149-7bca16eceefe" returned: 0 in 0.421s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:48 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-a4bdb429-ebb8-4db8-aa68-458f46b11df6 tempest-SnapshotsActionsTest-1702071401 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.32a591ff-65cf-4cd2-8149-7bca16eceefe is being set with open permissions: ugo+rw
Apr 02 10:27:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a4bdb429-ebb8-4db8-aa68-458f46b11df6 tempest-SnapshotsActionsTest-1702071401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.32a591ff-65cf-4cd2-8149-7bca16eceefe {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:48 devstack sudo[85891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.32a591ff-65cf-4cd2-8149-7bca16eceefe
Apr 02 10:27:48 devstack sudo[85891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:48 devstack sudo[85889]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9" returned: 0 in 0.460s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.6aab8b0c-b96c-4e4a-aef6-3d331f497fa3 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:48 devstack sudo[85891]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a4bdb429-ebb8-4db8-aa68-458f46b11df6 tempest-SnapshotsActionsTest-1702071401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.32a591ff-65cf-4cd2-8149-7bca16eceefe" returned: 0 in 0.393s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:48 devstack sudo[85897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.6aab8b0c-b96c-4e4a-aef6-3d331f497fa3
Apr 02 10:27:48 devstack sudo[85897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a4bdb429-ebb8-4db8-aa68-458f46b11df6 tempest-SnapshotsActionsTest-1702071401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.006s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:27:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f249a5e9-0e5f-408c-b2e1-9d8d441db71e tempest-GroupsV314Test-677498788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.850s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:27:48 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f249a5e9-0e5f-408c-b2e1-9d8d441db71e tempest-GroupsV314Test-677498788 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8d8317cf-493a-4b44-bbd8-3ba7c127c839,created_at=2026-04-02T08:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1537227796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8d8317cf-493a-4b44-bbd8-3ba7c127c839,host='devstack@QuobyteHD#QuobyteHD',id=6748b06e-96b4-43a4-920e-6c1981a600f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3382549129fd4df4b399e87b4a460ff4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:27:48Z,use_quota=True,user_id='ab14a4fcbc514188a0430852fa45069f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3008d1e9-dc6f-41a2-be01-7efcf5a19e0c),volume_type_id=3008d1e9-dc6f-41a2-be01-7efcf5a19e0c)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:27:48 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-f249a5e9-0e5f-408c-b2e1-9d8d441db71e tempest-GroupsV314Test-677498788 None] Creating volume 6748b06e-96b4-43a4-920e-6c1981a600f4 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:27:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f249a5e9-0e5f-408c-b2e1-9d8d441db71e tempest-GroupsV314Test-677498788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:27:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f249a5e9-0e5f-408c-b2e1-9d8d441db71e tempest-GroupsV314Test-677498788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:27:48 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f249a5e9-0e5f-408c-b2e1-9d8d441db71e tempest-GroupsV314Test-677498788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:27:48 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f249a5e9-0e5f-408c-b2e1-9d8d441db71e tempest-GroupsV314Test-677498788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:27:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f249a5e9-0e5f-408c-b2e1-9d8d441db71e tempest-GroupsV314Test-677498788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:27:48 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f249a5e9-0e5f-408c-b2e1-9d8d441db71e tempest-GroupsV314Test-677498788 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:27:48 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-f249a5e9-0e5f-408c-b2e1-9d8d441db71e tempest-GroupsV314Test-677498788 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:27:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f249a5e9-0e5f-408c-b2e1-9d8d441db71e tempest-GroupsV314Test-677498788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:48 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-a4bdb429-ebb8-4db8-aa68-458f46b11df6 tempest-SnapshotsActionsTest-1702071401 None] Create snapshot completed successfully
Apr 02 10:27:48 devstack sudo[85900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4 1073741824
Apr 02 10:27:48 devstack sudo[85900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:49 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-6d88fe77-97ce-4a92-8e68-367eefb8debd tempest-SnapshotsActionsTest-1402635934 None] Acquiring lock "cinder-32a591ff-65cf-4cd2-8149-7bca16eceefe-delete_snapshot" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:27:49 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-6d88fe77-97ce-4a92-8e68-367eefb8debd tempest-SnapshotsActionsTest-1402635934 None] Lock "cinder-32a591ff-65cf-4cd2-8149-7bca16eceefe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:27:49 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-6d88fe77-97ce-4a92-8e68-367eefb8debd tempest-SnapshotsActionsTest-1402635934 None] Acquiring lock "cinder-quobyte-93162c96-8352-4cd5-a05e-f5a59c6083d5" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:27:49 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-6d88fe77-97ce-4a92-8e68-367eefb8debd tempest-SnapshotsActionsTest-1402635934 None] Lock "cinder-quobyte-93162c96-8352-4cd5-a05e-f5a59c6083d5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:27:49 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-6d88fe77-97ce-4a92-8e68-367eefb8debd tempest-SnapshotsActionsTest-1402635934 None] Acquiring lock "cinder-quobyte-32a591ff-65cf-4cd2-8149-7bca16eceefe" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:27:49 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-6d88fe77-97ce-4a92-8e68-367eefb8debd tempest-SnapshotsActionsTest-1402635934 None] Lock "cinder-quobyte-32a591ff-65cf-4cd2-8149-7bca16eceefe" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:27:49 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-6d88fe77-97ce-4a92-8e68-367eefb8debd tempest-SnapshotsActionsTest-1402635934 None] Deleting offline snapshot 32a591ff-65cf-4cd2-8149-7bca16eceefe of volume 93162c96-8352-4cd5-a05e-f5a59c6083d5 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:27:49 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-6d88fe77-97ce-4a92-8e68-367eefb8debd tempest-SnapshotsActionsTest-1402635934 None] snapshot_file for this snap is: volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.32a591ff-65cf-4cd2-8149-7bca16eceefe {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:27:49 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e3bd5a-1a5a-4cee-8a4d-ce5ce037468c]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6d88fe77-97ce-4a92-8e68-367eefb8debd tempest-SnapshotsActionsTest-1402635934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.32a591ff-65cf-4cd2-8149-7bca16eceefe {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:49 devstack sudo[85927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.32a591ff-65cf-4cd2-8149-7bca16eceefe
Apr 02 10:27:49 devstack sudo[85927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:49 devstack sudo[85900]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f249a5e9-0e5f-408c-b2e1-9d8d441db71e tempest-GroupsV314Test-677498788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4 1073741824" returned: 0 in 0.803s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f249a5e9-0e5f-408c-b2e1-9d8d441db71e tempest-GroupsV314Test-677498788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:49 devstack sudo[85897]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.6aab8b0c-b96c-4e4a-aef6-3d331f497fa3" returned: 0 in 0.944s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.6aab8b0c-b96c-4e4a-aef6-3d331f497fa3 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:49 devstack sudo[85936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4
Apr 02 10:27:49 devstack sudo[85936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:49 devstack sudo[85937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.6aab8b0c-b96c-4e4a-aef6-3d331f497fa3
Apr 02 10:27:49 devstack sudo[85937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:50 devstack sudo[85927]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6d88fe77-97ce-4a92-8e68-367eefb8debd tempest-SnapshotsActionsTest-1402635934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.32a591ff-65cf-4cd2-8149-7bca16eceefe" returned: 0 in 0.774s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:50 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-6d88fe77-97ce-4a92-8e68-367eefb8debd tempest-SnapshotsActionsTest-1402635934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93162c96-8352-4cd5-a05e-f5a59c6083d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:27:50 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4aa9ad-0ef5-498b-8156-26d7fec029fe]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6d88fe77-97ce-4a92-8e68-367eefb8debd tempest-SnapshotsActionsTest-1402635934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:50 devstack sudo[85945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48
Apr 02 10:27:50 devstack sudo[85945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:50 devstack sudo[85937]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:50 devstack sudo[85936]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.6aab8b0c-b96c-4e4a-aef6-3d331f497fa3" returned: 0 in 0.559s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.f688cc04-6a2b-4ebf-a08a-28be89485327 -F qcow2 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f249a5e9-0e5f-408c-b2e1-9d8d441db71e tempest-GroupsV314Test-677498788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4" returned: 0 in 0.600s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:50 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f249a5e9-0e5f-408c-b2e1-9d8d441db71e tempest-GroupsV314Test-677498788 None] <== create_volume: return (1477ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:27:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f249a5e9-0e5f-408c-b2e1-9d8d441db71e tempest-GroupsV314Test-677498788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:27:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f249a5e9-0e5f-408c-b2e1-9d8d441db71e tempest-GroupsV314Test-677498788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf623c7d-1791-401d-9dcc-a44fa9fa1870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6748b06e-96b4-43a4-920e-6c1981a600f4', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:50 devstack sudo[85948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.f688cc04-6a2b-4ebf-a08a-28be89485327 -F qcow2
Apr 02 10:27:50 devstack sudo[85948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f249a5e9-0e5f-408c-b2e1-9d8d441db71e tempest-GroupsV314Test-677498788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (034e5d7c-1d71-4e7a-9531-fc8feb5cfef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:50 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-f249a5e9-0e5f-408c-b2e1-9d8d441db71e tempest-GroupsV314Test-677498788 None] Volume volume-6748b06e-96b4-43a4-920e-6c1981a600f4 (6748b06e-96b4-43a4-920e-6c1981a600f4): created successfully
Apr 02 10:27:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f249a5e9-0e5f-408c-b2e1-9d8d441db71e tempest-GroupsV314Test-677498788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (034e5d7c-1d71-4e7a-9531-fc8feb5cfef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f249a5e9-0e5f-408c-b2e1-9d8d441db71e tempest-GroupsV314Test-677498788 None] Flow 'volume_create_manager' (cd33188f-15e2-4dbc-989b-f282924f2472) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:27:50 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-f249a5e9-0e5f-408c-b2e1-9d8d441db71e tempest-GroupsV314Test-677498788 None] Created volume successfully.
Apr 02 10:27:50 devstack sudo[85945]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6d88fe77-97ce-4a92-8e68-367eefb8debd tempest-SnapshotsActionsTest-1402635934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48" returned: 0 in 0.670s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:50 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-6d88fe77-97ce-4a92-8e68-367eefb8debd tempest-SnapshotsActionsTest-1402635934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93162c96-8352-4cd5-a05e-f5a59c6083d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:27:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6d88fe77-97ce-4a92-8e68-367eefb8debd tempest-SnapshotsActionsTest-1402635934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.32a591ff-65cf-4cd2-8149-7bca16eceefe {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:50 devstack sudo[85956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.32a591ff-65cf-4cd2-8149-7bca16eceefe
Apr 02 10:27:50 devstack sudo[85956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:50 devstack sudo[85948]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.f688cc04-6a2b-4ebf-a08a-28be89485327 -F qcow2" returned: 0 in 0.635s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:51 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Lock "cinder-quobyte-6aab8b0c-b96c-4e4a-aef6-3d331f497fa3" released by "_delete_snapshot" :: held 4.906s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:27:51 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Lock "cinder-quobyte-39462c73-bdbd-4dae-8767-23efb0fcd9d9" released by "delete_snapshot" :: held 4.919s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:27:51 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Created reservations ['233b9a05-e594-4c06-bfab-123abd3f802c', '507296a8-dd75-40c2-b0e6-732f493c035b', 'c989d933-4b01-45f7-bca2-85e953fefd06', '1421fe1d-16e9-423c-a41a-16226b706863'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:27:51 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Delete snapshot completed successfully.
Apr 02 10:27:51 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Lock "cinder-6aab8b0c-b96c-4e4a-aef6-3d331f497fa3-delete_snapshot" released by "delete_snapshot" :: held 5.031s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:27:51 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Acquiring lock "cinder-f688cc04-6a2b-4ebf-a08a-28be89485327-delete_snapshot" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:27:51 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Lock "cinder-f688cc04-6a2b-4ebf-a08a-28be89485327-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:27:51 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Acquiring lock "cinder-quobyte-39462c73-bdbd-4dae-8767-23efb0fcd9d9" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:27:51 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Lock "cinder-quobyte-39462c73-bdbd-4dae-8767-23efb0fcd9d9" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:27:51 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Acquiring lock "cinder-quobyte-f688cc04-6a2b-4ebf-a08a-28be89485327" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:27:51 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Lock "cinder-quobyte-f688cc04-6a2b-4ebf-a08a-28be89485327" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:27:51 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Deleting offline snapshot f688cc04-6a2b-4ebf-a08a-28be89485327 of volume 39462c73-bdbd-4dae-8767-23efb0fcd9d9 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:27:51 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] snapshot_file for this snap is: volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.f688cc04-6a2b-4ebf-a08a-28be89485327 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:27:51 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20c4829-8820-4288-bde2-b7e5e5f1277f]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.f688cc04-6a2b-4ebf-a08a-28be89485327 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:51 devstack sudo[85959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.f688cc04-6a2b-4ebf-a08a-28be89485327
Apr 02 10:27:51 devstack sudo[85959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:51 devstack sudo[85956]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6d88fe77-97ce-4a92-8e68-367eefb8debd tempest-SnapshotsActionsTest-1402635934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.32a591ff-65cf-4cd2-8149-7bca16eceefe" returned: 0 in 0.598s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6d88fe77-97ce-4a92-8e68-367eefb8debd tempest-SnapshotsActionsTest-1402635934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.32a591ff-65cf-4cd2-8149-7bca16eceefe {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:51 devstack sudo[85964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.32a591ff-65cf-4cd2-8149-7bca16eceefe
Apr 02 10:27:51 devstack sudo[85964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:51 devstack sudo[85959]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.f688cc04-6a2b-4ebf-a08a-28be89485327" returned: 0 in 0.539s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:51 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:27:51 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[073cc6c6-31c5-4ff3-8dda-ed6291fa161e]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:51 devstack sudo[85969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9
Apr 02 10:27:51 devstack sudo[85969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:52 devstack sudo[85964]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6d88fe77-97ce-4a92-8e68-367eefb8debd tempest-SnapshotsActionsTest-1402635934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.32a591ff-65cf-4cd2-8149-7bca16eceefe" returned: 0 in 0.551s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:52 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-6d88fe77-97ce-4a92-8e68-367eefb8debd tempest-SnapshotsActionsTest-1402635934 None] Lock "cinder-quobyte-32a591ff-65cf-4cd2-8149-7bca16eceefe" released by "_delete_snapshot" :: held 2.690s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:27:52 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-6d88fe77-97ce-4a92-8e68-367eefb8debd tempest-SnapshotsActionsTest-1402635934 None] Lock "cinder-quobyte-93162c96-8352-4cd5-a05e-f5a59c6083d5" released by "delete_snapshot" :: held 2.712s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:27:52 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-6d88fe77-97ce-4a92-8e68-367eefb8debd tempest-SnapshotsActionsTest-1402635934 None] Created reservations ['0f7af168-6715-42bb-82bf-b21fe1d09a3f', 'e9b0777c-a92b-496c-95c6-e0eddaf32521', 'c3a69469-5c64-4905-9479-a85b32bf5741', 'c1853dba-b3fc-4973-a05c-f1c3fc447dec'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:27:52 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-6d88fe77-97ce-4a92-8e68-367eefb8debd tempest-SnapshotsActionsTest-1402635934 None] Delete snapshot completed successfully.
Apr 02 10:27:52 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-6d88fe77-97ce-4a92-8e68-367eefb8debd tempest-SnapshotsActionsTest-1402635934 None] Lock "cinder-32a591ff-65cf-4cd2-8149-7bca16eceefe-delete_snapshot" released by "delete_snapshot" :: held 2.906s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:27:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:27:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:27:52 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Cloning volume 6748b06e-96b4-43a4-920e-6c1981a600f4 to volume 4c4ecafd-7d8b-43d9-bd78-2a68838222fb
Apr 02 10:27:52 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Creating offline snapshot 607eed25-7c2c-4eae-9857-7fb29a2b0f4b of volume 6748b06e-96b4-43a4-920e-6c1981a600f4 {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:27:52 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2abaa7-b973-4ba1-9458-76a4a9f617d8]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:52 devstack sudo[85969]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9" returned: 0 in 0.722s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.f688cc04-6a2b-4ebf-a08a-28be89485327 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:52 devstack sudo[85976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.f688cc04-6a2b-4ebf-a08a-28be89485327
Apr 02 10:27:52 devstack sudo[85976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:52 devstack sudo[85975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4
Apr 02 10:27:52 devstack sudo[85975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bbe7eeb6-19e5-400e-9464-a7bcc4f1d7b5 tempest-SnapshotsActionsTest-1702071401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:27:52 devstack sudo[85975]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4" returned: 0 in 0.587s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4.607eed25-7c2c-4eae-9857-7fb29a2b0f4b 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:53 devstack sudo[85985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4.607eed25-7c2c-4eae-9857-7fb29a2b0f4b 1G
Apr 02 10:27:53 devstack sudo[85985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:53 devstack sudo[85976]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.f688cc04-6a2b-4ebf-a08a-28be89485327" returned: 0 in 0.584s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.f688cc04-6a2b-4ebf-a08a-28be89485327 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:53 devstack sudo[85987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.f688cc04-6a2b-4ebf-a08a-28be89485327
Apr 02 10:27:53 devstack sudo[85987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:53 devstack sudo[85987]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9.f688cc04-6a2b-4ebf-a08a-28be89485327" returned: 0 in 0.604s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:53 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Lock "cinder-quobyte-f688cc04-6a2b-4ebf-a08a-28be89485327" released by "_delete_snapshot" :: held 2.513s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:27:53 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Lock "cinder-quobyte-39462c73-bdbd-4dae-8767-23efb0fcd9d9" released by "delete_snapshot" :: held 2.525s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:27:53 devstack cinder-volume[82102]: DEBUG dbcounter [-] [82102] Writing DB stats cinder:SELECT=157,cinder:UPDATE=155,cinder:INSERT=45,cinder:DELETE=12 {{(pid=82102) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 02 10:27:53 devstack sudo[85985]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4.607eed25-7c2c-4eae-9857-7fb29a2b0f4b 1G" returned: 0 in 0.700s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6748b06e-96b4-43a4-920e-6c1981a600f4 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4.607eed25-7c2c-4eae-9857-7fb29a2b0f4b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:53 devstack sudo[86018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6748b06e-96b4-43a4-920e-6c1981a600f4 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4.607eed25-7c2c-4eae-9857-7fb29a2b0f4b
Apr 02 10:27:53 devstack sudo[86018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:53 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Created reservations ['c73d2b10-db5a-449e-8420-6b6ef7c2dd40', '9c246a81-2c98-439e-a9a9-909ce21ff3a1', '899887d4-24a3-4a83-96d8-bd5097a1b243', '5846a1a6-90b9-4b2b-917a-c66fb22c0e8d'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:27:53 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Delete snapshot completed successfully.
Apr 02 10:27:53 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Lock "cinder-f688cc04-6a2b-4ebf-a08a-28be89485327-delete_snapshot" released by "delete_snapshot" :: held 2.674s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:27:53 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Snapshots deleted, issuing volume delete {{(pid=82102) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 02 10:27:53 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Acquiring lock "cinder-quobyte-39462c73-bdbd-4dae-8767-23efb0fcd9d9" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:27:53 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Lock "cinder-quobyte-39462c73-bdbd-4dae-8767-23efb0fcd9d9" acquired by "delete_volume" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:27:53 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1339a594-2a03-482e-9f5b-31f6ec4967c3]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:53 devstack sudo[86021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9
Apr 02 10:27:53 devstack sudo[86021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:54 devstack sudo[86018]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6748b06e-96b4-43a4-920e-6c1981a600f4 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4.607eed25-7c2c-4eae-9857-7fb29a2b0f4b" returned: 0 in 0.555s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:54 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4.607eed25-7c2c-4eae-9857-7fb29a2b0f4b is being set with open permissions: ugo+rw: NotImplementedError
Apr 02 10:27:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4.607eed25-7c2c-4eae-9857-7fb29a2b0f4b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:54 devstack sudo[86047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4.607eed25-7c2c-4eae-9857-7fb29a2b0f4b
Apr 02 10:27:54 devstack sudo[86047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:54 devstack sudo[86021]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9" returned: 0 in 0.669s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:54 devstack sudo[86052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9
Apr 02 10:27:54 devstack sudo[86052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:54 devstack sudo[86047]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4.607eed25-7c2c-4eae-9857-7fb29a2b0f4b" returned: 0 in 0.642s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:54 devstack cinder-volume[82102]: DEBUG dbcounter [-] [82102] Writing DB stats cinder:UPDATE=126,cinder:SELECT=148,cinder:INSERT=51,cinder:DELETE=10 {{(pid=82102) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 02 10:27:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:54 devstack sudo[86056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4.info
Apr 02 10:27:54 devstack sudo[86056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:55 devstack sudo[86052]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-39462c73-bdbd-4dae-8767-23efb0fcd9d9" returned: 0 in 0.610s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:55 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Lock "cinder-quobyte-39462c73-bdbd-4dae-8767-23efb0fcd9d9" released by "delete_volume" :: held 1.316s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:27:55 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Created reservations ['fc770061-db32-4384-9cee-534bc42a594b', '5b7b76c8-eed8-432b-b5d9-c86f56d4779b', 'a838e1d8-6710-4ffe-af9f-48c0bf2cc3f1', '167ccf1d-1466-4b9b-93f2-82ad80f0fc2c'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:27:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:27:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:27:55 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:27:55 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:27:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:27:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:55 devstack sudo[86059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:27:55 devstack sudo[86059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:55 devstack sudo[86056]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4.info" returned: 0 in 0.603s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:55 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 02 10:27:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:55 devstack sudo[86062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4.info
Apr 02 10:27:55 devstack sudo[86062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:55 devstack sudo[86059]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.517s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:55 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:27:55 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Deleted volume successfully.
Apr 02 10:27:55 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3a33683b-6509-439b-a28f-91af1ec4e789 tempest-VolumesDeleteCascade-1697419128 None] Lock "cinder-39462c73-bdbd-4dae-8767-23efb0fcd9d9-delete_volume" released by "delete_volume" :: held 9.737s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:27:56 devstack sudo[86062]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4.info" returned: 0 in 0.575s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:56 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Acquiring lock "cinder-quobyte-4c4ecafd-7d8b-43d9-bd78-2a68838222fb" by "_copy_volume_from_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:27:56 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Lock "cinder-quobyte-4c4ecafd-7d8b-43d9-bd78-2a68838222fb" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:27:56 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] snapshot: 607eed25-7c2c-4eae-9857-7fb29a2b0f4b, volume: 4c4ecafd-7d8b-43d9-bd78-2a68838222fb,  {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 02 10:27:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:27:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:27:56 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:27:56 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:27:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:27:56 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8570261d-2423-411b-9656-3df8b28a6233]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4.607eed25-7c2c-4eae-9857-7fb29a2b0f4b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:56 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-83dbf8a5-ecd4-46c0-86a9-d8ef23227ad7 tempest-VolumesDeleteCascade-1697419128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:27:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-83dbf8a5-ecd4-46c0-86a9-d8ef23227ad7 tempest-VolumesDeleteCascade-1697419128 None] Flow 'volume_create_manager' (196642be-6520-4a49-a13a-c3eb0b4df02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:27:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-83dbf8a5-ecd4-46c0-86a9-d8ef23227ad7 tempest-VolumesDeleteCascade-1697419128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d4c604-8ad7-44a9-aaf5-049ab76cc4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-83dbf8a5-ecd4-46c0-86a9-d8ef23227ad7 tempest-VolumesDeleteCascade-1697419128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d4c604-8ad7-44a9-aaf5-049ab76cc4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-959724452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14b501d3-558d-4666-a0f4-761b0ab45dc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dce5c061482a48959f920570c813ecd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:27:56Z,use_quota=True,user_id='490c3c25edd94111b560f07aff989618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:56 devstack sudo[86071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4.607eed25-7c2c-4eae-9857-7fb29a2b0f4b
Apr 02 10:27:56 devstack sudo[86071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-83dbf8a5-ecd4-46c0-86a9-d8ef23227ad7 tempest-VolumesDeleteCascade-1697419128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70bf537b-2ae4-4e81-b4b7-a751a843648d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-83dbf8a5-ecd4-46c0-86a9-d8ef23227ad7 tempest-VolumesDeleteCascade-1697419128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70bf537b-2ae4-4e81-b4b7-a751a843648d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-83dbf8a5-ecd4-46c0-86a9-d8ef23227ad7 tempest-VolumesDeleteCascade-1697419128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54fa7eed-0437-4e5d-a118-1f5e257cc317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-83dbf8a5-ecd4-46c0-86a9-d8ef23227ad7 tempest-VolumesDeleteCascade-1697419128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54fa7eed-0437-4e5d-a118-1f5e257cc317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14b501d3-558d-4666-a0f4-761b0ab45dc0', 'volume_name': 'volume-14b501d3-558d-4666-a0f4-761b0ab45dc0', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-83dbf8a5-ecd4-46c0-86a9-d8ef23227ad7 tempest-VolumesDeleteCascade-1697419128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a152fb40-240f-401c-88fd-1fc7a5cc4f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-83dbf8a5-ecd4-46c0-86a9-d8ef23227ad7 tempest-VolumesDeleteCascade-1697419128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a152fb40-240f-401c-88fd-1fc7a5cc4f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:27:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-83dbf8a5-ecd4-46c0-86a9-d8ef23227ad7 tempest-VolumesDeleteCascade-1697419128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7654c05f-437a-4007-b5ea-2e1c2a41b521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:27:56 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-83dbf8a5-ecd4-46c0-86a9-d8ef23227ad7 tempest-VolumesDeleteCascade-1697419128 None] Volume 14b501d3-558d-4666-a0f4-761b0ab45dc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14b501d3-558d-4666-a0f4-761b0ab45dc0', 'volume_size': 1}
Apr 02 10:27:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-83dbf8a5-ecd4-46c0-86a9-d8ef23227ad7 tempest-VolumesDeleteCascade-1697419128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:27:56 devstack sudo[86071]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4.607eed25-7c2c-4eae-9857-7fb29a2b0f4b" returned: 0 in 0.556s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:56 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6748b06e-96b4-43a4-920e-6c1981a600f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:27:56 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4 {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 02 10:27:56 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Creating direct copy from snapshot {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 02 10:27:56 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56569f0-2035-4499-b3b2-17c494b4eca0]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:56 devstack sudo[86095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4
Apr 02 10:27:56 devstack sudo[86095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:57 devstack sudo[86095]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4" returned: 0 in 0.465s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:57 devstack cinder-volume[82102]: DEBUG cinder.utils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Path /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c4ecafd-7d8b-43d9-bd78-2a68838222fb not found in is_blk_device check {{(pid=82102) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 02 10:27:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c4ecafd-7d8b-43d9-bd78-2a68838222fb {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:57 devstack sudo[86101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c4ecafd-7d8b-43d9-bd78-2a68838222fb
Apr 02 10:27:57 devstack sudo[86101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:59 devstack cinder-volume[82102]: INFO cinder.volume.manager [req-ad27c285-b6b6-4438-9580-00e9b7bcd25e req-c0e5d867-6607-46aa-8561-2408c066d4a3 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Terminate volume connection completed successfully.
Apr 02 10:27:59 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-ad27c285-b6b6-4438-9580-00e9b7bcd25e req-c0e5d867-6607-46aa-8561-2408c066d4a3 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Deleting attachment 1db5cdd0-e13d-4020-b644-26e938643d28. {{(pid=82102) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 02 10:27:59 devstack sudo[86101]: pam_unix(sudo:session): session closed for user root
Apr 02 10:27:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c4ecafd-7d8b-43d9-bd78-2a68838222fb" returned: 0 in 2.523s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:27:59 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5e5c86-e8d5-44db-bcbf-c84a54b44adb]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:27:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:27:59 devstack sudo[86128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4
Apr 02 10:27:59 devstack sudo[86128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:27:59 devstack cinder-volume[82102]: DEBUG cinder.coordination [req-ad27c285-b6b6-4438-9580-00e9b7bcd25e req-e698db45-c9f3-49d7-9929-5738a271e897 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Acquiring lock "cinder-34d6d557-e4bb-479b-9939-b32c59d38629-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:27:59 devstack cinder-volume[82102]: DEBUG cinder.coordination [req-ad27c285-b6b6-4438-9580-00e9b7bcd25e req-e698db45-c9f3-49d7-9929-5738a271e897 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Lock "cinder-34d6d557-e4bb-479b-9939-b32c59d38629-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:00 devstack cinder-volume[82102]: DEBUG cinder.coordination [req-ad27c285-b6b6-4438-9580-00e9b7bcd25e req-e698db45-c9f3-49d7-9929-5738a271e897 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Acquiring lock "cinder-quobyte-34d6d557-e4bb-479b-9939-b32c59d38629" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:00 devstack cinder-volume[82102]: DEBUG cinder.coordination [req-ad27c285-b6b6-4438-9580-00e9b7bcd25e req-e698db45-c9f3-49d7-9929-5738a271e897 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Lock "cinder-quobyte-34d6d557-e4bb-479b-9939-b32c59d38629" acquired by "delete_volume" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:00 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[389164c3-d169-49a5-b70c-59a6f8457a89]: (4, 'raw') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:28:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-ad27c285-b6b6-4438-9580-00e9b7bcd25e req-e698db45-c9f3-49d7-9929-5738a271e897 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:00 devstack sudo[86130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629
Apr 02 10:28:00 devstack sudo[86130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:00 devstack sudo[86128]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4" returned: 0 in 0.672s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:00 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Image conversion details: src /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4, size 1024.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c4ecafd-7d8b-43d9-bd78-2a68838222fb {{(pid=82102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 02 10:28:00 devstack cinder-volume[82102]: INFO cinder.image.image_utils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Converted 1024.00 MB image at 405.71 MB/s
Apr 02 10:28:00 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c4ecafd-7d8b-43d9-bd78-2a68838222fb is being set with open permissions: ugo+rw: NotImplementedError
Apr 02 10:28:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c4ecafd-7d8b-43d9-bd78-2a68838222fb {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:00 devstack sudo[86135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c4ecafd-7d8b-43d9-bd78-2a68838222fb
Apr 02 10:28:00 devstack sudo[86135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:00 devstack sudo[86130]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-ad27c285-b6b6-4438-9580-00e9b7bcd25e req-e698db45-c9f3-49d7-9929-5738a271e897 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629" returned: 0 in 0.488s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-ad27c285-b6b6-4438-9580-00e9b7bcd25e req-e698db45-c9f3-49d7-9929-5738a271e897 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:00 devstack sudo[86139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629
Apr 02 10:28:00 devstack sudo[86139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:00 devstack sudo[86135]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c4ecafd-7d8b-43d9-bd78-2a68838222fb" returned: 0 in 0.458s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:00 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Lock "cinder-quobyte-4c4ecafd-7d8b-43d9-bd78-2a68838222fb" released by "_copy_volume_from_snapshot" :: held 4.733s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:00 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Acquiring lock "cinder-quobyte-607eed25-7c2c-4eae-9857-7fb29a2b0f4b" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:00 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Lock "cinder-quobyte-607eed25-7c2c-4eae-9857-7fb29a2b0f4b" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:00 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Deleting offline snapshot 607eed25-7c2c-4eae-9857-7fb29a2b0f4b of volume 6748b06e-96b4-43a4-920e-6c1981a600f4 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:28:00 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] snapshot_file for this snap is: volume-6748b06e-96b4-43a4-920e-6c1981a600f4.607eed25-7c2c-4eae-9857-7fb29a2b0f4b {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:28:00 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2215dd5f-dc1c-49e0-8023-443cc6a4c848]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:28:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4.607eed25-7c2c-4eae-9857-7fb29a2b0f4b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:00 devstack sudo[86143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4.607eed25-7c2c-4eae-9857-7fb29a2b0f4b
Apr 02 10:28:00 devstack sudo[86143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:01 devstack sudo[86139]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-ad27c285-b6b6-4438-9580-00e9b7bcd25e req-e698db45-c9f3-49d7-9929-5738a271e897 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629" returned: 1 in 0.489s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-ad27c285-b6b6-4438-9580-00e9b7bcd25e req-e698db45-c9f3-49d7-9929-5738a271e897 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629' failed. Not Retrying. {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 02 10:28:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-ad27c285-b6b6-4438-9580-00e9b7bcd25e req-e698db45-c9f3-49d7-9929-5738a271e897 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:01 devstack sudo[86148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629
Apr 02 10:28:01 devstack sudo[86148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:01 devstack sudo[86143]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4.607eed25-7c2c-4eae-9857-7fb29a2b0f4b" returned: 0 in 0.491s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:01 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6748b06e-96b4-43a4-920e-6c1981a600f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:28:01 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff07d89f-30c3-4dc8-a0b8-ea6f71324db2]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:28:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:01 devstack sudo[86148]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-ad27c285-b6b6-4438-9580-00e9b7bcd25e req-e698db45-c9f3-49d7-9929-5738a271e897 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34d6d557-e4bb-479b-9939-b32c59d38629" returned: 0 in 0.456s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:01 devstack sudo[86154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4
Apr 02 10:28:01 devstack sudo[86154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:01 devstack cinder-volume[82102]: DEBUG cinder.coordination [req-ad27c285-b6b6-4438-9580-00e9b7bcd25e req-e698db45-c9f3-49d7-9929-5738a271e897 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Lock "cinder-quobyte-34d6d557-e4bb-479b-9939-b32c59d38629" released by "delete_volume" :: held 1.481s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:01 devstack cinder-volume[82102]: DEBUG cinder.quota [req-ad27c285-b6b6-4438-9580-00e9b7bcd25e req-e698db45-c9f3-49d7-9929-5738a271e897 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Created reservations ['20e6ad1c-bf44-41dc-bf95-fb697dc19de5', '8d727a17-5d47-45bc-9b29-724515ee8282', '1558819a-96f1-4f92-98b1-56b9f0744570', '064b5fd2-23a1-4e6d-94ef-5807ef472c49'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:28:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-ad27c285-b6b6-4438-9580-00e9b7bcd25e req-e698db45-c9f3-49d7-9929-5738a271e897 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-ad27c285-b6b6-4438-9580-00e9b7bcd25e req-e698db45-c9f3-49d7-9929-5738a271e897 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:01 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [req-ad27c285-b6b6-4438-9580-00e9b7bcd25e req-e698db45-c9f3-49d7-9929-5738a271e897 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:28:01 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [req-ad27c285-b6b6-4438-9580-00e9b7bcd25e req-e698db45-c9f3-49d7-9929-5738a271e897 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:28:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-ad27c285-b6b6-4438-9580-00e9b7bcd25e req-e698db45-c9f3-49d7-9929-5738a271e897 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-ad27c285-b6b6-4438-9580-00e9b7bcd25e req-e698db45-c9f3-49d7-9929-5738a271e897 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:01 devstack sudo[86156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:28:01 devstack sudo[86156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:01 devstack sudo[86154]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4" returned: 0 in 0.479s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4.607eed25-7c2c-4eae-9857-7fb29a2b0f4b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:01 devstack sudo[86161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4.607eed25-7c2c-4eae-9857-7fb29a2b0f4b
Apr 02 10:28:01 devstack sudo[86161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:02 devstack sudo[86156]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-ad27c285-b6b6-4438-9580-00e9b7bcd25e req-e698db45-c9f3-49d7-9929-5738a271e897 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.428s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:02 devstack cinder-volume[82102]: DEBUG cinder.manager [req-ad27c285-b6b6-4438-9580-00e9b7bcd25e req-e698db45-c9f3-49d7-9929-5738a271e897 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:28:02 devstack cinder-volume[82102]: INFO cinder.volume.manager [req-ad27c285-b6b6-4438-9580-00e9b7bcd25e req-e698db45-c9f3-49d7-9929-5738a271e897 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Deleted volume successfully.
Apr 02 10:28:02 devstack cinder-volume[82102]: DEBUG cinder.coordination [req-ad27c285-b6b6-4438-9580-00e9b7bcd25e req-e698db45-c9f3-49d7-9929-5738a271e897 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Lock "cinder-34d6d557-e4bb-479b-9939-b32c59d38629-delete_volume" released by "delete_volume" :: held 2.047s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:02 devstack sudo[86161]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4.607eed25-7c2c-4eae-9857-7fb29a2b0f4b" returned: 0 in 0.454s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4.607eed25-7c2c-4eae-9857-7fb29a2b0f4b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:02 devstack sudo[86167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4.607eed25-7c2c-4eae-9857-7fb29a2b0f4b
Apr 02 10:28:02 devstack sudo[86167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:02 devstack sudo[86167]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4.607eed25-7c2c-4eae-9857-7fb29a2b0f4b" returned: 0 in 0.468s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:02 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Lock "cinder-quobyte-607eed25-7c2c-4eae-9857-7fb29a2b0f4b" released by "_delete_snapshot" :: held 1.946s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.514s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bbe7eeb6-19e5-400e-9464-a7bcc4f1d7b5 tempest-SnapshotsActionsTest-1702071401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.081s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:02 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-bbe7eeb6-19e5-400e-9464-a7bcc4f1d7b5 tempest-SnapshotsActionsTest-1702071401 None] Creating offline snapshot d82edb9c-36e0-4c67-98c9-06a1b584d924 of volume 93162c96-8352-4cd5-a05e-f5a59c6083d5 {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:28:02 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c0f37d-c095-4119-bc5b-772481477579]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:28:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bbe7eeb6-19e5-400e-9464-a7bcc4f1d7b5 tempest-SnapshotsActionsTest-1702071401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:02 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-3515f5a9-a83e-4a1f-81bc-393865c6750c tempest-GroupsV314Test-677498788 None] Create group from source-group-8d8317cf-493a-4b44-bbd8-3ba7c127c839 completed successfully.
Apr 02 10:28:02 devstack sudo[86170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48
Apr 02 10:28:02 devstack sudo[86170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:03 devstack sudo[86170]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bbe7eeb6-19e5-400e-9464-a7bcc4f1d7b5 tempest-SnapshotsActionsTest-1702071401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48" returned: 0 in 0.478s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:03 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-bbe7eeb6-19e5-400e-9464-a7bcc4f1d7b5 tempest-SnapshotsActionsTest-1702071401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93162c96-8352-4cd5-a05e-f5a59c6083d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:28:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bbe7eeb6-19e5-400e-9464-a7bcc4f1d7b5 tempest-SnapshotsActionsTest-1702071401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.d82edb9c-36e0-4c67-98c9-06a1b584d924 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:03 devstack sudo[86175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.d82edb9c-36e0-4c67-98c9-06a1b584d924 1G
Apr 02 10:28:03 devstack sudo[86175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:03 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-ef3de5e6-b3ea-4ac3-9ffc-ded7822f15c0 tempest-GroupsV314Test-677498788 None] Acquiring lock "cinder-quobyte-4c4ecafd-7d8b-43d9-bd78-2a68838222fb" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:03 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-ef3de5e6-b3ea-4ac3-9ffc-ded7822f15c0 tempest-GroupsV314Test-677498788 None] Lock "cinder-quobyte-4c4ecafd-7d8b-43d9-bd78-2a68838222fb" acquired by "delete_volume" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:03 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb23d78-75e9-49b9-8e97-7a58e9c27c23]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:28:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ef3de5e6-b3ea-4ac3-9ffc-ded7822f15c0 tempest-GroupsV314Test-677498788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c4ecafd-7d8b-43d9-bd78-2a68838222fb {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:03 devstack sudo[86180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c4ecafd-7d8b-43d9-bd78-2a68838222fb
Apr 02 10:28:03 devstack sudo[86180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:03 devstack sudo[86175]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bbe7eeb6-19e5-400e-9464-a7bcc4f1d7b5 tempest-SnapshotsActionsTest-1702071401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.d82edb9c-36e0-4c67-98c9-06a1b584d924 1G" returned: 0 in 0.609s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bbe7eeb6-19e5-400e-9464-a7bcc4f1d7b5 tempest-SnapshotsActionsTest-1702071401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.d82edb9c-36e0-4c67-98c9-06a1b584d924 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:04 devstack sudo[86188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.d82edb9c-36e0-4c67-98c9-06a1b584d924
Apr 02 10:28:04 devstack sudo[86188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:04 devstack sudo[86180]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ef3de5e6-b3ea-4ac3-9ffc-ded7822f15c0 tempest-GroupsV314Test-677498788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c4ecafd-7d8b-43d9-bd78-2a68838222fb" returned: 0 in 0.698s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ef3de5e6-b3ea-4ac3-9ffc-ded7822f15c0 tempest-GroupsV314Test-677498788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c4ecafd-7d8b-43d9-bd78-2a68838222fb {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:04 devstack sudo[86212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c4ecafd-7d8b-43d9-bd78-2a68838222fb
Apr 02 10:28:04 devstack sudo[86212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:04 devstack sudo[86188]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bbe7eeb6-19e5-400e-9464-a7bcc4f1d7b5 tempest-SnapshotsActionsTest-1702071401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.d82edb9c-36e0-4c67-98c9-06a1b584d924" returned: 0 in 0.608s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:04 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-bbe7eeb6-19e5-400e-9464-a7bcc4f1d7b5 tempest-SnapshotsActionsTest-1702071401 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.d82edb9c-36e0-4c67-98c9-06a1b584d924 is being set with open permissions: ugo+rw
Apr 02 10:28:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bbe7eeb6-19e5-400e-9464-a7bcc4f1d7b5 tempest-SnapshotsActionsTest-1702071401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.d82edb9c-36e0-4c67-98c9-06a1b584d924 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:04 devstack sudo[86214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.d82edb9c-36e0-4c67-98c9-06a1b584d924
Apr 02 10:28:04 devstack sudo[86214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:05 devstack sudo[86212]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ef3de5e6-b3ea-4ac3-9ffc-ded7822f15c0 tempest-GroupsV314Test-677498788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c4ecafd-7d8b-43d9-bd78-2a68838222fb" returned: 0 in 0.528s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:05 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-ef3de5e6-b3ea-4ac3-9ffc-ded7822f15c0 tempest-GroupsV314Test-677498788 None] Lock "cinder-quobyte-4c4ecafd-7d8b-43d9-bd78-2a68838222fb" released by "delete_volume" :: held 1.251s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:05 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-ef3de5e6-b3ea-4ac3-9ffc-ded7822f15c0 tempest-GroupsV314Test-677498788 None] Created reservations ['fddcc8b2-c422-4634-a2f0-aae20474e8b5'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:28:05 devstack cinder-volume[82102]: WARNING cinder.quota [None req-ef3de5e6-b3ea-4ac3-9ffc-ded7822f15c0 tempest-GroupsV314Test-677498788 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-955684429 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-955684429, it is now deprecated. Please use the default quota class for default quota.
Apr 02 10:28:05 devstack cinder-volume[82102]: WARNING cinder.quota [None req-ef3de5e6-b3ea-4ac3-9ffc-ded7822f15c0 tempest-GroupsV314Test-677498788 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-955684429 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-955684429, it is now deprecated. Please use the default quota class for default quota.
Apr 02 10:28:05 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-ef3de5e6-b3ea-4ac3-9ffc-ded7822f15c0 tempest-GroupsV314Test-677498788 None] Created reservations ['dfc4233b-6134-40fc-84f3-e1d252902624', '9f9a1be3-0316-4ad4-a07f-29c8f0660e10', '1f1c0c62-769a-4454-a7f5-5cab8cc9091c', 'e8c814bb-f63f-417c-ba9b-f54d19e5c5e0'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:28:05 devstack sudo[86214]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bbe7eeb6-19e5-400e-9464-a7bcc4f1d7b5 tempest-SnapshotsActionsTest-1702071401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.d82edb9c-36e0-4c67-98c9-06a1b584d924" returned: 0 in 0.503s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bbe7eeb6-19e5-400e-9464-a7bcc4f1d7b5 tempest-SnapshotsActionsTest-1702071401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.274s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-83dbf8a5-ecd4-46c0-86a9-d8ef23227ad7 tempest-VolumesDeleteCascade-1697419128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.847s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:05 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-83dbf8a5-ecd4-46c0-86a9-d8ef23227ad7 tempest-VolumesDeleteCascade-1697419128 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-959724452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14b501d3-558d-4666-a0f4-761b0ab45dc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dce5c061482a48959f920570c813ecd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:27:56Z,use_quota=True,user_id='490c3c25edd94111b560f07aff989618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:28:05 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-83dbf8a5-ecd4-46c0-86a9-d8ef23227ad7 tempest-VolumesDeleteCascade-1697419128 None] Creating volume 14b501d3-558d-4666-a0f4-761b0ab45dc0 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:28:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-83dbf8a5-ecd4-46c0-86a9-d8ef23227ad7 tempest-VolumesDeleteCascade-1697419128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-83dbf8a5-ecd4-46c0-86a9-d8ef23227ad7 tempest-VolumesDeleteCascade-1697419128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:05 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-83dbf8a5-ecd4-46c0-86a9-d8ef23227ad7 tempest-VolumesDeleteCascade-1697419128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:28:05 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-83dbf8a5-ecd4-46c0-86a9-d8ef23227ad7 tempest-VolumesDeleteCascade-1697419128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:28:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-83dbf8a5-ecd4-46c0-86a9-d8ef23227ad7 tempest-VolumesDeleteCascade-1697419128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:05 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-83dbf8a5-ecd4-46c0-86a9-d8ef23227ad7 tempest-VolumesDeleteCascade-1697419128 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:28:05 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-83dbf8a5-ecd4-46c0-86a9-d8ef23227ad7 tempest-VolumesDeleteCascade-1697419128 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:28:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-83dbf8a5-ecd4-46c0-86a9-d8ef23227ad7 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:05 devstack sudo[86221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0 1073741824
Apr 02 10:28:05 devstack sudo[86221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:05 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-bbe7eeb6-19e5-400e-9464-a7bcc4f1d7b5 tempest-SnapshotsActionsTest-1702071401 None] Create snapshot completed successfully
Apr 02 10:28:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ef3de5e6-b3ea-4ac3-9ffc-ded7822f15c0 tempest-GroupsV314Test-677498788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ef3de5e6-b3ea-4ac3-9ffc-ded7822f15c0 tempest-GroupsV314Test-677498788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:05 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-ef3de5e6-b3ea-4ac3-9ffc-ded7822f15c0 tempest-GroupsV314Test-677498788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:28:05 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-ef3de5e6-b3ea-4ac3-9ffc-ded7822f15c0 tempest-GroupsV314Test-677498788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:28:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ef3de5e6-b3ea-4ac3-9ffc-ded7822f15c0 tempest-GroupsV314Test-677498788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ef3de5e6-b3ea-4ac3-9ffc-ded7822f15c0 tempest-GroupsV314Test-677498788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:05 devstack sudo[86223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:28:05 devstack sudo[86223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:05 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-50598fbe-03f2-45ee-90ff-4ff62b5f5c97 tempest-SnapshotsActionsTest-1402635934 None] Acquiring lock "cinder-d82edb9c-36e0-4c67-98c9-06a1b584d924-delete_snapshot" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:05 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-50598fbe-03f2-45ee-90ff-4ff62b5f5c97 tempest-SnapshotsActionsTest-1402635934 None] Lock "cinder-d82edb9c-36e0-4c67-98c9-06a1b584d924-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:05 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-50598fbe-03f2-45ee-90ff-4ff62b5f5c97 tempest-SnapshotsActionsTest-1402635934 None] Acquiring lock "cinder-quobyte-93162c96-8352-4cd5-a05e-f5a59c6083d5" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:05 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-50598fbe-03f2-45ee-90ff-4ff62b5f5c97 tempest-SnapshotsActionsTest-1402635934 None] Lock "cinder-quobyte-93162c96-8352-4cd5-a05e-f5a59c6083d5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:05 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-50598fbe-03f2-45ee-90ff-4ff62b5f5c97 tempest-SnapshotsActionsTest-1402635934 None] Acquiring lock "cinder-quobyte-d82edb9c-36e0-4c67-98c9-06a1b584d924" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:05 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-50598fbe-03f2-45ee-90ff-4ff62b5f5c97 tempest-SnapshotsActionsTest-1402635934 None] Lock "cinder-quobyte-d82edb9c-36e0-4c67-98c9-06a1b584d924" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:05 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-50598fbe-03f2-45ee-90ff-4ff62b5f5c97 tempest-SnapshotsActionsTest-1402635934 None] Deleting offline snapshot d82edb9c-36e0-4c67-98c9-06a1b584d924 of volume 93162c96-8352-4cd5-a05e-f5a59c6083d5 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:28:05 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-50598fbe-03f2-45ee-90ff-4ff62b5f5c97 tempest-SnapshotsActionsTest-1402635934 None] snapshot_file for this snap is: volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.d82edb9c-36e0-4c67-98c9-06a1b584d924 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:28:05 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f74775-b399-4174-a9cb-048c0e0f2f37]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:28:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-50598fbe-03f2-45ee-90ff-4ff62b5f5c97 tempest-SnapshotsActionsTest-1402635934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.d82edb9c-36e0-4c67-98c9-06a1b584d924 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:05 devstack sudo[86226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.d82edb9c-36e0-4c67-98c9-06a1b584d924
Apr 02 10:28:05 devstack sudo[86226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:05 devstack sudo[86221]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-83dbf8a5-ecd4-46c0-86a9-d8ef23227ad7 tempest-VolumesDeleteCascade-1697419128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0 1073741824" returned: 0 in 0.706s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-83dbf8a5-ecd4-46c0-86a9-d8ef23227ad7 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:05 devstack sudo[86233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0
Apr 02 10:28:05 devstack sudo[86233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:05 devstack sudo[86223]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ef3de5e6-b3ea-4ac3-9ffc-ded7822f15c0 tempest-GroupsV314Test-677498788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.706s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:05 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-ef3de5e6-b3ea-4ac3-9ffc-ded7822f15c0 tempest-GroupsV314Test-677498788 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:28:05 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-ef3de5e6-b3ea-4ac3-9ffc-ded7822f15c0 tempest-GroupsV314Test-677498788 None] Delete group completed successfully.
Apr 02 10:28:06 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-cfe1aab5-7ba5-41f4-a119-0c27fa9aa57c tempest-GroupsV314Test-677498788 None] Acquiring lock "cinder-quobyte-6748b06e-96b4-43a4-920e-6c1981a600f4" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:06 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-cfe1aab5-7ba5-41f4-a119-0c27fa9aa57c tempest-GroupsV314Test-677498788 None] Lock "cinder-quobyte-6748b06e-96b4-43a4-920e-6c1981a600f4" acquired by "delete_volume" :: waited 0.013s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:06 devstack sudo[86226]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-50598fbe-03f2-45ee-90ff-4ff62b5f5c97 tempest-SnapshotsActionsTest-1402635934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.d82edb9c-36e0-4c67-98c9-06a1b584d924" returned: 0 in 0.613s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:06 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-50598fbe-03f2-45ee-90ff-4ff62b5f5c97 tempest-SnapshotsActionsTest-1402635934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93162c96-8352-4cd5-a05e-f5a59c6083d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:28:06 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[924c8cd4-95b0-42ae-ab09-116eae0f10fb]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:28:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cfe1aab5-7ba5-41f4-a119-0c27fa9aa57c tempest-GroupsV314Test-677498788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:06 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf93a2c-ab28-4d1d-9124-be6c2ce458cb]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:28:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-50598fbe-03f2-45ee-90ff-4ff62b5f5c97 tempest-SnapshotsActionsTest-1402635934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:06 devstack sudo[86238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4
Apr 02 10:28:06 devstack sudo[86238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:06 devstack sudo[86239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48
Apr 02 10:28:06 devstack sudo[86239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:06 devstack sudo[86233]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-83dbf8a5-ecd4-46c0-86a9-d8ef23227ad7 tempest-VolumesDeleteCascade-1697419128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0" returned: 0 in 0.477s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:06 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-83dbf8a5-ecd4-46c0-86a9-d8ef23227ad7 tempest-VolumesDeleteCascade-1697419128 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:28:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-83dbf8a5-ecd4-46c0-86a9-d8ef23227ad7 tempest-VolumesDeleteCascade-1697419128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:06 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-83dbf8a5-ecd4-46c0-86a9-d8ef23227ad7 tempest-VolumesDeleteCascade-1697419128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7654c05f-437a-4007-b5ea-2e1c2a41b521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14b501d3-558d-4666-a0f4-761b0ab45dc0', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:06 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-83dbf8a5-ecd4-46c0-86a9-d8ef23227ad7 tempest-VolumesDeleteCascade-1697419128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e521c94-e1fc-42df-9acf-2b00b8e86c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:06 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-83dbf8a5-ecd4-46c0-86a9-d8ef23227ad7 tempest-VolumesDeleteCascade-1697419128 None] Volume volume-14b501d3-558d-4666-a0f4-761b0ab45dc0 (14b501d3-558d-4666-a0f4-761b0ab45dc0): created successfully
Apr 02 10:28:06 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-83dbf8a5-ecd4-46c0-86a9-d8ef23227ad7 tempest-VolumesDeleteCascade-1697419128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e521c94-e1fc-42df-9acf-2b00b8e86c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:06 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-83dbf8a5-ecd4-46c0-86a9-d8ef23227ad7 tempest-VolumesDeleteCascade-1697419128 None] Flow 'volume_create_manager' (196642be-6520-4a49-a13a-c3eb0b4df02d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:28:06 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-83dbf8a5-ecd4-46c0-86a9-d8ef23227ad7 tempest-VolumesDeleteCascade-1697419128 None] Created volume successfully.
Apr 02 10:28:06 devstack sudo[86239]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-50598fbe-03f2-45ee-90ff-4ff62b5f5c97 tempest-SnapshotsActionsTest-1402635934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48" returned: 0 in 0.538s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:06 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-50598fbe-03f2-45ee-90ff-4ff62b5f5c97 tempest-SnapshotsActionsTest-1402635934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93162c96-8352-4cd5-a05e-f5a59c6083d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:28:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-50598fbe-03f2-45ee-90ff-4ff62b5f5c97 tempest-SnapshotsActionsTest-1402635934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.d82edb9c-36e0-4c67-98c9-06a1b584d924 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:06 devstack sudo[86238]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cfe1aab5-7ba5-41f4-a119-0c27fa9aa57c tempest-GroupsV314Test-677498788 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4" returned: 0 in 0.554s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cfe1aab5-7ba5-41f4-a119-0c27fa9aa57c tempest-GroupsV314Test-677498788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:06 devstack sudo[86249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.d82edb9c-36e0-4c67-98c9-06a1b584d924
Apr 02 10:28:06 devstack sudo[86249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:06 devstack sudo[86250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4
Apr 02 10:28:06 devstack sudo[86250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4b111b7-9256-4517-a2c4-eb2d75bfbdb4 tempest-VolumesDeleteCascade-1697419128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4b111b7-9256-4517-a2c4-eb2d75bfbdb4 tempest-VolumesDeleteCascade-1697419128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:07 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-d4b111b7-9256-4517-a2c4-eb2d75bfbdb4 tempest-VolumesDeleteCascade-1697419128 None] Creating offline snapshot 07ce1adb-bebd-4f64-bd1e-da549641495b of volume 14b501d3-558d-4666-a0f4-761b0ab45dc0 {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:28:07 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3926c71-8340-4503-9ff1-25c59453d941]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:28:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d4b111b7-9256-4517-a2c4-eb2d75bfbdb4 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:07 devstack sudo[86250]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cfe1aab5-7ba5-41f4-a119-0c27fa9aa57c tempest-GroupsV314Test-677498788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6748b06e-96b4-43a4-920e-6c1981a600f4" returned: 0 in 0.445s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:07 devstack sudo[86256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0
Apr 02 10:28:07 devstack sudo[86256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:07 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-cfe1aab5-7ba5-41f4-a119-0c27fa9aa57c tempest-GroupsV314Test-677498788 None] Lock "cinder-quobyte-6748b06e-96b4-43a4-920e-6c1981a600f4" released by "delete_volume" :: held 1.052s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:07 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-cfe1aab5-7ba5-41f4-a119-0c27fa9aa57c tempest-GroupsV314Test-677498788 None] Created reservations ['7316e7c0-9476-4dbd-86ca-e512dfe53ab5'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:28:07 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-cfe1aab5-7ba5-41f4-a119-0c27fa9aa57c tempest-GroupsV314Test-677498788 None] Created reservations ['a8677c8f-6b0c-401c-9c1d-58a3cf951c53', '4e531046-cc44-4de0-a1bb-927786bc028b', '738c67a9-82f4-45e7-b701-cf42fae1cec4', '6d619f34-6304-4c29-b9dd-ad727226bb5d'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:28:07 devstack sudo[86249]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-50598fbe-03f2-45ee-90ff-4ff62b5f5c97 tempest-SnapshotsActionsTest-1402635934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.d82edb9c-36e0-4c67-98c9-06a1b584d924" returned: 0 in 0.590s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-50598fbe-03f2-45ee-90ff-4ff62b5f5c97 tempest-SnapshotsActionsTest-1402635934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.d82edb9c-36e0-4c67-98c9-06a1b584d924 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:07 devstack sudo[86259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.d82edb9c-36e0-4c67-98c9-06a1b584d924
Apr 02 10:28:07 devstack sudo[86259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-cfe1aab5-7ba5-41f4-a119-0c27fa9aa57c tempest-GroupsV314Test-677498788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-cfe1aab5-7ba5-41f4-a119-0c27fa9aa57c tempest-GroupsV314Test-677498788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:07 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-cfe1aab5-7ba5-41f4-a119-0c27fa9aa57c tempest-GroupsV314Test-677498788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:28:07 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-cfe1aab5-7ba5-41f4-a119-0c27fa9aa57c tempest-GroupsV314Test-677498788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:28:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-cfe1aab5-7ba5-41f4-a119-0c27fa9aa57c tempest-GroupsV314Test-677498788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cfe1aab5-7ba5-41f4-a119-0c27fa9aa57c tempest-GroupsV314Test-677498788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:07 devstack sudo[86261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:28:07 devstack sudo[86261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:07 devstack sudo[86256]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d4b111b7-9256-4517-a2c4-eb2d75bfbdb4 tempest-VolumesDeleteCascade-1697419128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0" returned: 0 in 0.606s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d4b111b7-9256-4517-a2c4-eb2d75bfbdb4 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0.07ce1adb-bebd-4f64-bd1e-da549641495b 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:07 devstack sudo[86266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0.07ce1adb-bebd-4f64-bd1e-da549641495b 1G
Apr 02 10:28:07 devstack sudo[86266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:07 devstack sudo[86259]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-50598fbe-03f2-45ee-90ff-4ff62b5f5c97 tempest-SnapshotsActionsTest-1402635934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.d82edb9c-36e0-4c67-98c9-06a1b584d924" returned: 0 in 0.545s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:07 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-50598fbe-03f2-45ee-90ff-4ff62b5f5c97 tempest-SnapshotsActionsTest-1402635934 None] Lock "cinder-quobyte-d82edb9c-36e0-4c67-98c9-06a1b584d924" released by "_delete_snapshot" :: held 2.344s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:07 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-50598fbe-03f2-45ee-90ff-4ff62b5f5c97 tempest-SnapshotsActionsTest-1402635934 None] Lock "cinder-quobyte-93162c96-8352-4cd5-a05e-f5a59c6083d5" released by "delete_snapshot" :: held 2.358s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:07 devstack sudo[86261]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cfe1aab5-7ba5-41f4-a119-0c27fa9aa57c tempest-GroupsV314Test-677498788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.495s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:07 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-cfe1aab5-7ba5-41f4-a119-0c27fa9aa57c tempest-GroupsV314Test-677498788 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:28:07 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-cfe1aab5-7ba5-41f4-a119-0c27fa9aa57c tempest-GroupsV314Test-677498788 None] Delete group completed successfully.
Apr 02 10:28:07 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-50598fbe-03f2-45ee-90ff-4ff62b5f5c97 tempest-SnapshotsActionsTest-1402635934 None] Created reservations ['6e68abe2-a2ef-4ba6-a573-5410c4bfe645', 'ef9b5447-e4fc-40a1-995e-86e66c6ad443', '23e73917-3d2b-44a5-b072-4ee225d10ec2', '14677f3e-5b4a-41e4-8f74-52f14fc8f5d3'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:28:07 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-50598fbe-03f2-45ee-90ff-4ff62b5f5c97 tempest-SnapshotsActionsTest-1402635934 None] Delete snapshot completed successfully.
Apr 02 10:28:07 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-50598fbe-03f2-45ee-90ff-4ff62b5f5c97 tempest-SnapshotsActionsTest-1402635934 None] Lock "cinder-d82edb9c-36e0-4c67-98c9-06a1b584d924-delete_snapshot" released by "delete_snapshot" :: held 2.506s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:08 devstack sudo[86266]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d4b111b7-9256-4517-a2c4-eb2d75bfbdb4 tempest-VolumesDeleteCascade-1697419128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0.07ce1adb-bebd-4f64-bd1e-da549641495b 1G" returned: 0 in 0.525s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d4b111b7-9256-4517-a2c4-eb2d75bfbdb4 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14b501d3-558d-4666-a0f4-761b0ab45dc0 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0.07ce1adb-bebd-4f64-bd1e-da549641495b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:08 devstack sudo[86273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14b501d3-558d-4666-a0f4-761b0ab45dc0 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0.07ce1adb-bebd-4f64-bd1e-da549641495b
Apr 02 10:28:08 devstack sudo[86273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:08 devstack cinder-volume[82102]: DEBUG oslo_service.periodic_task [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 02 10:28:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:28:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:28:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:08 devstack sudo[86284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:28:08 devstack sudo[86284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:08 devstack sudo[86273]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d4b111b7-9256-4517-a2c4-eb2d75bfbdb4 tempest-VolumesDeleteCascade-1697419128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14b501d3-558d-4666-a0f4-761b0ab45dc0 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0.07ce1adb-bebd-4f64-bd1e-da549641495b" returned: 0 in 0.530s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:08 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-d4b111b7-9256-4517-a2c4-eb2d75bfbdb4 tempest-VolumesDeleteCascade-1697419128 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0.07ce1adb-bebd-4f64-bd1e-da549641495b is being set with open permissions: ugo+rw
Apr 02 10:28:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d4b111b7-9256-4517-a2c4-eb2d75bfbdb4 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0.07ce1adb-bebd-4f64-bd1e-da549641495b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:08 devstack sudo[86286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0.07ce1adb-bebd-4f64-bd1e-da549641495b
Apr 02 10:28:08 devstack sudo[86286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:09 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-b26305c2-c0d0-48d4-9114-652200dc4df6 tempest-SnapshotsActionsTest-1702071401 None] Acquiring lock "cinder-7d966108-7f52-413e-834d-32384f7bfa48-delete_snapshot" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:09 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-b26305c2-c0d0-48d4-9114-652200dc4df6 tempest-SnapshotsActionsTest-1702071401 None] Lock "cinder-7d966108-7f52-413e-834d-32384f7bfa48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:09 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-b26305c2-c0d0-48d4-9114-652200dc4df6 tempest-SnapshotsActionsTest-1702071401 None] Acquiring lock "cinder-quobyte-93162c96-8352-4cd5-a05e-f5a59c6083d5" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:09 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-b26305c2-c0d0-48d4-9114-652200dc4df6 tempest-SnapshotsActionsTest-1702071401 None] Lock "cinder-quobyte-93162c96-8352-4cd5-a05e-f5a59c6083d5" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:09 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-b26305c2-c0d0-48d4-9114-652200dc4df6 tempest-SnapshotsActionsTest-1702071401 None] Acquiring lock "cinder-quobyte-7d966108-7f52-413e-834d-32384f7bfa48" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:09 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-b26305c2-c0d0-48d4-9114-652200dc4df6 tempest-SnapshotsActionsTest-1702071401 None] Lock "cinder-quobyte-7d966108-7f52-413e-834d-32384f7bfa48" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:09 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-b26305c2-c0d0-48d4-9114-652200dc4df6 tempest-SnapshotsActionsTest-1702071401 None] Deleting offline snapshot 7d966108-7f52-413e-834d-32384f7bfa48 of volume 93162c96-8352-4cd5-a05e-f5a59c6083d5 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:28:09 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-b26305c2-c0d0-48d4-9114-652200dc4df6 tempest-SnapshotsActionsTest-1702071401 None] snapshot_file for this snap is: volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:28:09 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91a5246-6c6d-4ede-8c61-0b86ec26ebb2]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:28:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b26305c2-c0d0-48d4-9114-652200dc4df6 tempest-SnapshotsActionsTest-1702071401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:09 devstack sudo[86289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48
Apr 02 10:28:09 devstack sudo[86289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:09 devstack sudo[86284]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.697s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:09 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:28:09 devstack sudo[86286]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d4b111b7-9256-4517-a2c4-eb2d75bfbdb4 tempest-VolumesDeleteCascade-1697419128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0.07ce1adb-bebd-4f64-bd1e-da549641495b" returned: 0 in 0.695s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d4b111b7-9256-4517-a2c4-eb2d75bfbdb4 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:09 devstack sudo[86293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0.info
Apr 02 10:28:09 devstack sudo[86293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:09 devstack sudo[86289]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b26305c2-c0d0-48d4-9114-652200dc4df6 tempest-SnapshotsActionsTest-1702071401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48" returned: 0 in 0.580s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:09 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-b26305c2-c0d0-48d4-9114-652200dc4df6 tempest-SnapshotsActionsTest-1702071401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93162c96-8352-4cd5-a05e-f5a59c6083d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:28:09 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[feece911-be95-4e83-ae1b-165b179b0be6]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:28:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b26305c2-c0d0-48d4-9114-652200dc4df6 tempest-SnapshotsActionsTest-1702071401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:09 devstack sudo[86298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5
Apr 02 10:28:09 devstack sudo[86298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:10 devstack sudo[86293]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d4b111b7-9256-4517-a2c4-eb2d75bfbdb4 tempest-VolumesDeleteCascade-1697419128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0.info" returned: 0 in 0.534s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:10 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-d4b111b7-9256-4517-a2c4-eb2d75bfbdb4 tempest-VolumesDeleteCascade-1697419128 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0.info is being set with open permissions: ugo+rw
Apr 02 10:28:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d4b111b7-9256-4517-a2c4-eb2d75bfbdb4 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:10 devstack sudo[86301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0.info
Apr 02 10:28:10 devstack sudo[86301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:10 devstack sudo[86298]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b26305c2-c0d0-48d4-9114-652200dc4df6 tempest-SnapshotsActionsTest-1702071401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5" returned: 0 in 0.672s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b26305c2-c0d0-48d4-9114-652200dc4df6 tempest-SnapshotsActionsTest-1702071401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:10 devstack sudo[86306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48
Apr 02 10:28:10 devstack sudo[86306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:10 devstack sudo[86301]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d4b111b7-9256-4517-a2c4-eb2d75bfbdb4 tempest-VolumesDeleteCascade-1697419128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0.info" returned: 0 in 0.647s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4b111b7-9256-4517-a2c4-eb2d75bfbdb4 tempest-VolumesDeleteCascade-1697419128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.627s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:10 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-d4b111b7-9256-4517-a2c4-eb2d75bfbdb4 tempest-VolumesDeleteCascade-1697419128 None] Create snapshot completed successfully
Apr 02 10:28:11 devstack sudo[86306]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b26305c2-c0d0-48d4-9114-652200dc4df6 tempest-SnapshotsActionsTest-1702071401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48" returned: 0 in 0.617s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b26305c2-c0d0-48d4-9114-652200dc4df6 tempest-SnapshotsActionsTest-1702071401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:11 devstack sudo[86313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48
Apr 02 10:28:11 devstack sudo[86313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:11 devstack sudo[86313]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b26305c2-c0d0-48d4-9114-652200dc4df6 tempest-SnapshotsActionsTest-1702071401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5.7d966108-7f52-413e-834d-32384f7bfa48" returned: 0 in 0.630s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-b26305c2-c0d0-48d4-9114-652200dc4df6 tempest-SnapshotsActionsTest-1702071401 None] Lock "cinder-quobyte-7d966108-7f52-413e-834d-32384f7bfa48" released by "_delete_snapshot" :: held 2.580s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-b26305c2-c0d0-48d4-9114-652200dc4df6 tempest-SnapshotsActionsTest-1702071401 None] Lock "cinder-quobyte-93162c96-8352-4cd5-a05e-f5a59c6083d5" released by "delete_snapshot" :: held 2.600s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Flow 'volume_create_manager' (c001fb21-f957-4daf-ac9a-dbc12186472a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a70f6afa-76bd-4328-9ce7-67b37a314de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a70f6afa-76bd-4328-9ce7-67b37a314de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1968333782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dce5c061482a48959f920570c813ecd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=07ce1adb-bebd-4f64-bd1e-da549641495b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:28:12Z,use_quota=True,user_id='490c3c25edd94111b560f07aff989618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b7df53-780d-478b-99cd-90fda2c05247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b7df53-780d-478b-99cd-90fda2c05247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bab5e87-6246-46e0-987f-736a554a51cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bab5e87-6246-46e0-987f-736a554a51cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4', 'volume_name': 'volume-f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4', 'volume_size': 1, 'snapshot_id': '07ce1adb-bebd-4f64-bd1e-da549641495b'}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (add00c04-0dac-4306-a79a-cb3412ee6951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (add00c04-0dac-4306-a79a-cb3412ee6951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d58cfb-8b00-4c94-b171-2cbebb933fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:11 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Volume f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4', 'volume_size': 1, 'snapshot_id': '07ce1adb-bebd-4f64-bd1e-da549641495b'}
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Acquiring lock "cinder-quobyte-07ce1adb-bebd-4f64-bd1e-da549641495b-f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4" by "_create_volume_from_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-b26305c2-c0d0-48d4-9114-652200dc4df6 tempest-SnapshotsActionsTest-1702071401 None] Created reservations ['7b7b4bad-814b-4c2e-af20-ed1f84bd6698', 'b825c8a9-ee9c-4f2e-9dc3-74fd8ec70e68', '54be7ac0-1809-4964-9823-6b5ec2502a74', '2b9e8044-c26e-433f-ad92-24c8bb827a83'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Lock "cinder-quobyte-07ce1adb-bebd-4f64-bd1e-da549641495b-f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Creating volume f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4 from snapshot 07ce1adb-bebd-4f64-bd1e-da549641495b {{(pid=82102) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Acquiring lock "cinder-quobyte-f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4" by "_copy_volume_from_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Lock "cinder-quobyte-f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] snapshot: 07ce1adb-bebd-4f64-bd1e-da549641495b, volume: f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4,  {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:11 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-b26305c2-c0d0-48d4-9114-652200dc4df6 tempest-SnapshotsActionsTest-1702071401 None] Delete snapshot completed successfully.
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[da783547-e403-4101-b9b6-163ed6b44d81]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:28:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0.07ce1adb-bebd-4f64-bd1e-da549641495b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:12 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-b26305c2-c0d0-48d4-9114-652200dc4df6 tempest-SnapshotsActionsTest-1702071401 None] Lock "cinder-7d966108-7f52-413e-834d-32384f7bfa48-delete_snapshot" released by "delete_snapshot" :: held 2.867s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:12 devstack sudo[86339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0.07ce1adb-bebd-4f64-bd1e-da549641495b
Apr 02 10:28:12 devstack sudo[86339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:12 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-834e7d75-7d69-4c1b-a2f3-99b91c104116 tempest-SnapshotsActionsTest-1702071401 None] Acquiring lock "cinder-93162c96-8352-4cd5-a05e-f5a59c6083d5-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:12 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-834e7d75-7d69-4c1b-a2f3-99b91c104116 tempest-SnapshotsActionsTest-1702071401 None] Lock "cinder-93162c96-8352-4cd5-a05e-f5a59c6083d5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:12 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-834e7d75-7d69-4c1b-a2f3-99b91c104116 tempest-SnapshotsActionsTest-1702071401 None] Acquiring lock "cinder-quobyte-93162c96-8352-4cd5-a05e-f5a59c6083d5" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:12 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-834e7d75-7d69-4c1b-a2f3-99b91c104116 tempest-SnapshotsActionsTest-1702071401 None] Lock "cinder-quobyte-93162c96-8352-4cd5-a05e-f5a59c6083d5" acquired by "delete_volume" :: waited 0.012s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:12 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da1a92e-65e5-47b0-9abf-6b1b88986982]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:28:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-834e7d75-7d69-4c1b-a2f3-99b91c104116 tempest-SnapshotsActionsTest-1702071401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:12 devstack sudo[86343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5
Apr 02 10:28:12 devstack sudo[86343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:12 devstack sudo[86339]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0.07ce1adb-bebd-4f64-bd1e-da549641495b" returned: 0 in 0.794s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:12 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14b501d3-558d-4666-a0f4-761b0ab45dc0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:28:12 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0 {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 02 10:28:12 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Creating direct copy from snapshot {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 02 10:28:12 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2706fc-5524-4dda-8c42-9ff80d693aec]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:28:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:12 devstack sudo[86349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0
Apr 02 10:28:12 devstack sudo[86349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:13 devstack sudo[86343]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-834e7d75-7d69-4c1b-a2f3-99b91c104116 tempest-SnapshotsActionsTest-1702071401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5" returned: 0 in 0.594s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-834e7d75-7d69-4c1b-a2f3-99b91c104116 tempest-SnapshotsActionsTest-1702071401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:13 devstack sudo[86354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5
Apr 02 10:28:13 devstack sudo[86354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:13 devstack sudo[86349]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0" returned: 0 in 0.680s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:13 devstack cinder-volume[82102]: DEBUG cinder.utils [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Path /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4 not found in is_blk_device check {{(pid=82102) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 02 10:28:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:13 devstack sudo[86360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4
Apr 02 10:28:13 devstack sudo[86360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:13 devstack sudo[86354]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-834e7d75-7d69-4c1b-a2f3-99b91c104116 tempest-SnapshotsActionsTest-1702071401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-93162c96-8352-4cd5-a05e-f5a59c6083d5" returned: 0 in 0.552s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:13 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-834e7d75-7d69-4c1b-a2f3-99b91c104116 tempest-SnapshotsActionsTest-1702071401 None] Lock "cinder-quobyte-93162c96-8352-4cd5-a05e-f5a59c6083d5" released by "delete_volume" :: held 1.193s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:13 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-834e7d75-7d69-4c1b-a2f3-99b91c104116 tempest-SnapshotsActionsTest-1702071401 None] Created reservations ['d93fa99f-e4be-43b7-987a-238fcca7cab9', '4f87e301-9f3b-451c-beca-20d86adb387a', 'f4fe1d50-bfaa-49d7-be3b-2ced2f445326', '1fe0894a-2057-40bd-873d-02e264d37ca0'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:28:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-834e7d75-7d69-4c1b-a2f3-99b91c104116 tempest-SnapshotsActionsTest-1702071401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-834e7d75-7d69-4c1b-a2f3-99b91c104116 tempest-SnapshotsActionsTest-1702071401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:13 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-834e7d75-7d69-4c1b-a2f3-99b91c104116 tempest-SnapshotsActionsTest-1702071401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:28:13 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-834e7d75-7d69-4c1b-a2f3-99b91c104116 tempest-SnapshotsActionsTest-1702071401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:28:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-834e7d75-7d69-4c1b-a2f3-99b91c104116 tempest-SnapshotsActionsTest-1702071401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-834e7d75-7d69-4c1b-a2f3-99b91c104116 tempest-SnapshotsActionsTest-1702071401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:13 devstack sudo[86363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:28:13 devstack sudo[86363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:14 devstack cinder-volume[82102]: INFO cinder.volume.manager [req-b694cc46-161f-4004-82db-711831bbce3f req-42c8b4ba-c280-4a3a-9e49-a944246603eb tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Terminate volume connection completed successfully.
Apr 02 10:28:14 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [req-b694cc46-161f-4004-82db-711831bbce3f req-42c8b4ba-c280-4a3a-9e49-a944246603eb tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Deleting attachment 8fcb11f8-0dc6-403d-a2e3-02c382e0206f. {{(pid=82102) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 02 10:28:14 devstack sudo[86363]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-834e7d75-7d69-4c1b-a2f3-99b91c104116 tempest-SnapshotsActionsTest-1702071401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.795s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:14 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-834e7d75-7d69-4c1b-a2f3-99b91c104116 tempest-SnapshotsActionsTest-1702071401 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:28:14 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-834e7d75-7d69-4c1b-a2f3-99b91c104116 tempest-SnapshotsActionsTest-1702071401 None] Deleted volume successfully.
Apr 02 10:28:14 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-834e7d75-7d69-4c1b-a2f3-99b91c104116 tempest-SnapshotsActionsTest-1702071401 None] Lock "cinder-93162c96-8352-4cd5-a05e-f5a59c6083d5-delete_volume" released by "delete_volume" :: held 2.244s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:15 devstack cinder-volume[82102]: DEBUG cinder.coordination [req-b694cc46-161f-4004-82db-711831bbce3f req-b0cfa717-b932-44bc-8352-b69dc5e0b4a4 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Acquiring lock "cinder-139c024d-474a-4f27-ad01-b43a7f6f7eca-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:15 devstack cinder-volume[82102]: DEBUG cinder.coordination [req-b694cc46-161f-4004-82db-711831bbce3f req-b0cfa717-b932-44bc-8352-b69dc5e0b4a4 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Lock "cinder-139c024d-474a-4f27-ad01-b43a7f6f7eca-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:15 devstack cinder-volume[82102]: DEBUG cinder.coordination [req-b694cc46-161f-4004-82db-711831bbce3f req-b0cfa717-b932-44bc-8352-b69dc5e0b4a4 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Acquiring lock "cinder-quobyte-139c024d-474a-4f27-ad01-b43a7f6f7eca" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:15 devstack cinder-volume[82102]: DEBUG cinder.coordination [req-b694cc46-161f-4004-82db-711831bbce3f req-b0cfa717-b932-44bc-8352-b69dc5e0b4a4 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Lock "cinder-quobyte-139c024d-474a-4f27-ad01-b43a7f6f7eca" acquired by "delete_volume" :: waited 0.047s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:15 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab2e22a-1928-4c9c-8bc6-ad98d3831f69]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:28:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-b694cc46-161f-4004-82db-711831bbce3f req-b0cfa717-b932-44bc-8352-b69dc5e0b4a4 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-139c024d-474a-4f27-ad01-b43a7f6f7eca {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:15 devstack sudo[86376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-139c024d-474a-4f27-ad01-b43a7f6f7eca
Apr 02 10:28:15 devstack sudo[86376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:16 devstack sudo[86360]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4" returned: 0 in 2.699s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:16 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b522de-5423-422f-84a4-2bcbdba8c5a4]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:28:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:16 devstack sudo[86379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0
Apr 02 10:28:16 devstack sudo[86379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:16 devstack sudo[86376]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-b694cc46-161f-4004-82db-711831bbce3f req-b0cfa717-b932-44bc-8352-b69dc5e0b4a4 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-139c024d-474a-4f27-ad01-b43a7f6f7eca" returned: 0 in 1.114s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-b694cc46-161f-4004-82db-711831bbce3f req-b0cfa717-b932-44bc-8352-b69dc5e0b4a4 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-139c024d-474a-4f27-ad01-b43a7f6f7eca {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:16 devstack sudo[86384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-139c024d-474a-4f27-ad01-b43a7f6f7eca
Apr 02 10:28:16 devstack sudo[86384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:16 devstack sudo[86379]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0" returned: 0 in 0.776s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:16 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Image conversion details: src /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0, size 1024.00 MB, duration 2.70 sec, destination /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4 {{(pid=82102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 02 10:28:16 devstack cinder-volume[82102]: INFO cinder.image.image_utils [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Converted 1024.00 MB image at 379.23 MB/s
Apr 02 10:28:16 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4 is being set with open permissions: ugo+rw
Apr 02 10:28:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:16 devstack sudo[86390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4
Apr 02 10:28:17 devstack sudo[86390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:17 devstack sudo[86384]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-b694cc46-161f-4004-82db-711831bbce3f req-b0cfa717-b932-44bc-8352-b69dc5e0b4a4 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-139c024d-474a-4f27-ad01-b43a7f6f7eca" returned: 0 in 0.552s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:17 devstack cinder-volume[82102]: DEBUG cinder.coordination [req-b694cc46-161f-4004-82db-711831bbce3f req-b0cfa717-b932-44bc-8352-b69dc5e0b4a4 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Lock "cinder-quobyte-139c024d-474a-4f27-ad01-b43a7f6f7eca" released by "delete_volume" :: held 1.724s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:17 devstack cinder-volume[82102]: DEBUG cinder.quota [req-b694cc46-161f-4004-82db-711831bbce3f req-b0cfa717-b932-44bc-8352-b69dc5e0b4a4 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Created reservations ['3c533f6c-abde-4975-b845-de35b5e6b80f', '1364fdd9-e528-4a4c-8f4f-1b131ffdb71f', '278b7051-9128-478d-a48f-025436ac3df7', '920f66e5-3f33-4c91-b862-d3458166d647'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:28:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-b694cc46-161f-4004-82db-711831bbce3f req-b0cfa717-b932-44bc-8352-b69dc5e0b4a4 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-b694cc46-161f-4004-82db-711831bbce3f req-b0cfa717-b932-44bc-8352-b69dc5e0b4a4 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:17 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [req-b694cc46-161f-4004-82db-711831bbce3f req-b0cfa717-b932-44bc-8352-b69dc5e0b4a4 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:28:17 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [req-b694cc46-161f-4004-82db-711831bbce3f req-b0cfa717-b932-44bc-8352-b69dc5e0b4a4 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:28:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [req-b694cc46-161f-4004-82db-711831bbce3f req-b0cfa717-b932-44bc-8352-b69dc5e0b4a4 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-b694cc46-161f-4004-82db-711831bbce3f req-b0cfa717-b932-44bc-8352-b69dc5e0b4a4 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:17 devstack sudo[86392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:28:17 devstack sudo[86392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:17 devstack sudo[86390]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4" returned: 0 in 0.538s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:17 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Lock "cinder-quobyte-f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4" released by "_copy_volume_from_snapshot" :: held 5.561s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:17 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Lock "cinder-quobyte-07ce1adb-bebd-4f64-bd1e-da549641495b-f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4" released by "_create_volume_from_snapshot" :: held 5.596s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.616s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:17 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d58cfb-8b00-4c94-b171-2cbebb933fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4', 'volume_size': 1, 'snapshot_id': '07ce1adb-bebd-4f64-bd1e-da549641495b'}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:17 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbefad15-21af-47b1-ac67-acba57cfefea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:17 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Volume volume-f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4 (f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4): created successfully
Apr 02 10:28:17 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbefad15-21af-47b1-ac67-acba57cfefea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:17 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Flow 'volume_create_manager' (c001fb21-f957-4daf-ac9a-dbc12186472a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:28:17 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-3da6d65a-90f4-4ad0-874e-0d4ba362f997 tempest-VolumesDeleteCascade-1697419128 None] Created volume successfully.
Apr 02 10:28:17 devstack sudo[86392]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [req-b694cc46-161f-4004-82db-711831bbce3f req-b0cfa717-b932-44bc-8352-b69dc5e0b4a4 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.605s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:17 devstack cinder-volume[82102]: DEBUG cinder.manager [req-b694cc46-161f-4004-82db-711831bbce3f req-b0cfa717-b932-44bc-8352-b69dc5e0b4a4 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:28:17 devstack cinder-volume[82102]: INFO cinder.volume.manager [req-b694cc46-161f-4004-82db-711831bbce3f req-b0cfa717-b932-44bc-8352-b69dc5e0b4a4 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Deleted volume successfully.
Apr 02 10:28:17 devstack cinder-volume[82102]: DEBUG cinder.coordination [req-b694cc46-161f-4004-82db-711831bbce3f req-b0cfa717-b932-44bc-8352-b69dc5e0b4a4 tempest-ServerBootFromVolumeStableRescueTest-182334840 None] Lock "cinder-139c024d-474a-4f27-ad01-b43a7f6f7eca-delete_volume" released by "delete_volume" :: held 2.610s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:18 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] Acquiring lock "cinder-14b501d3-558d-4666-a0f4-761b0ab45dc0-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:18 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] Lock "cinder-14b501d3-558d-4666-a0f4-761b0ab45dc0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] Performing cascade delete. {{(pid=82102) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 02 10:28:18 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] Acquiring lock "cinder-07ce1adb-bebd-4f64-bd1e-da549641495b-delete_snapshot" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:18 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] Lock "cinder-07ce1adb-bebd-4f64-bd1e-da549641495b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:18 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] Acquiring lock "cinder-quobyte-14b501d3-558d-4666-a0f4-761b0ab45dc0" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:18 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] Lock "cinder-quobyte-14b501d3-558d-4666-a0f4-761b0ab45dc0" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:18 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] Acquiring lock "cinder-quobyte-07ce1adb-bebd-4f64-bd1e-da549641495b" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:18 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] Lock "cinder-quobyte-07ce1adb-bebd-4f64-bd1e-da549641495b" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:18 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] Deleting offline snapshot 07ce1adb-bebd-4f64-bd1e-da549641495b of volume 14b501d3-558d-4666-a0f4-761b0ab45dc0 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:28:18 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] snapshot_file for this snap is: volume-14b501d3-558d-4666-a0f4-761b0ab45dc0.07ce1adb-bebd-4f64-bd1e-da549641495b {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:28:18 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad0dcd6-e0f9-46e5-91ca-222a42461be1]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:28:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0.07ce1adb-bebd-4f64-bd1e-da549641495b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:18 devstack sudo[86396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0.07ce1adb-bebd-4f64-bd1e-da549641495b
Apr 02 10:28:18 devstack sudo[86396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:19 devstack sudo[86396]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0.07ce1adb-bebd-4f64-bd1e-da549641495b" returned: 0 in 0.720s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:19 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14b501d3-558d-4666-a0f4-761b0ab45dc0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:28:19 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb1ad9e-a4cf-4bee-a024-c935cd2bc326]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:28:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:19 devstack sudo[86401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0
Apr 02 10:28:19 devstack sudo[86401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:19 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-55d354c3-7b97-4d81-a764-290ff3e9fcff tempest-VolumeQuotasNegativeTestJSON-590254786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:28:19 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-55d354c3-7b97-4d81-a764-290ff3e9fcff tempest-VolumeQuotasNegativeTestJSON-590254786 None] Flow 'volume_create_manager' (10a0c0f2-410a-4b2b-ad3a-4e2a3816b3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:28:19 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-55d354c3-7b97-4d81-a764-290ff3e9fcff tempest-VolumeQuotasNegativeTestJSON-590254786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a7c2b6c-a04f-40b0-ad09-25f203c5b25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:19 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-55d354c3-7b97-4d81-a764-290ff3e9fcff tempest-VolumeQuotasNegativeTestJSON-590254786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a7c2b6c-a04f-40b0-ad09-25f203c5b25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1295431293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f46dc7-ae6b-4c69-b8fb-898d9b509eb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3c0cfb3f09246f68a3a38f1089d359a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:28:19Z,use_quota=True,user_id='075d23fe016a47a8be9cc0e16dc9ed17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:19 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-55d354c3-7b97-4d81-a764-290ff3e9fcff tempest-VolumeQuotasNegativeTestJSON-590254786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3244daaf-fc8d-49d6-a0e4-beb9642d15af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:19 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-55d354c3-7b97-4d81-a764-290ff3e9fcff tempest-VolumeQuotasNegativeTestJSON-590254786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3244daaf-fc8d-49d6-a0e4-beb9642d15af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:19 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-55d354c3-7b97-4d81-a764-290ff3e9fcff tempest-VolumeQuotasNegativeTestJSON-590254786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e9c9d0d-412c-4d11-b7dd-684dd259173a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:19 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-55d354c3-7b97-4d81-a764-290ff3e9fcff tempest-VolumeQuotasNegativeTestJSON-590254786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e9c9d0d-412c-4d11-b7dd-684dd259173a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0f46dc7-ae6b-4c69-b8fb-898d9b509eb2', 'volume_name': 'volume-d0f46dc7-ae6b-4c69-b8fb-898d9b509eb2', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:19 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-55d354c3-7b97-4d81-a764-290ff3e9fcff tempest-VolumeQuotasNegativeTestJSON-590254786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d0caf0-b830-4c7e-a44b-7b25261033e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:19 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-55d354c3-7b97-4d81-a764-290ff3e9fcff tempest-VolumeQuotasNegativeTestJSON-590254786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d0caf0-b830-4c7e-a44b-7b25261033e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:19 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-55d354c3-7b97-4d81-a764-290ff3e9fcff tempest-VolumeQuotasNegativeTestJSON-590254786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8b35104-ec1c-4214-a4d9-b099e379d915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:19 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-55d354c3-7b97-4d81-a764-290ff3e9fcff tempest-VolumeQuotasNegativeTestJSON-590254786 None] Volume d0f46dc7-ae6b-4c69-b8fb-898d9b509eb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0f46dc7-ae6b-4c69-b8fb-898d9b509eb2', 'volume_size': 1}
Apr 02 10:28:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-55d354c3-7b97-4d81-a764-290ff3e9fcff tempest-VolumeQuotasNegativeTestJSON-590254786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-55d354c3-7b97-4d81-a764-290ff3e9fcff tempest-VolumeQuotasNegativeTestJSON-590254786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:19 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-55d354c3-7b97-4d81-a764-290ff3e9fcff tempest-VolumeQuotasNegativeTestJSON-590254786 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1295431293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f46dc7-ae6b-4c69-b8fb-898d9b509eb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3c0cfb3f09246f68a3a38f1089d359a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:28:19Z,use_quota=True,user_id='075d23fe016a47a8be9cc0e16dc9ed17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:28:19 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-55d354c3-7b97-4d81-a764-290ff3e9fcff tempest-VolumeQuotasNegativeTestJSON-590254786 None] Creating volume d0f46dc7-ae6b-4c69-b8fb-898d9b509eb2 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:28:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-55d354c3-7b97-4d81-a764-290ff3e9fcff tempest-VolumeQuotasNegativeTestJSON-590254786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-55d354c3-7b97-4d81-a764-290ff3e9fcff tempest-VolumeQuotasNegativeTestJSON-590254786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:19 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-55d354c3-7b97-4d81-a764-290ff3e9fcff tempest-VolumeQuotasNegativeTestJSON-590254786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:28:19 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-55d354c3-7b97-4d81-a764-290ff3e9fcff tempest-VolumeQuotasNegativeTestJSON-590254786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:28:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-55d354c3-7b97-4d81-a764-290ff3e9fcff tempest-VolumeQuotasNegativeTestJSON-590254786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:19 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-55d354c3-7b97-4d81-a764-290ff3e9fcff tempest-VolumeQuotasNegativeTestJSON-590254786 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:28:19 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-55d354c3-7b97-4d81-a764-290ff3e9fcff tempest-VolumeQuotasNegativeTestJSON-590254786 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:28:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-55d354c3-7b97-4d81-a764-290ff3e9fcff tempest-VolumeQuotasNegativeTestJSON-590254786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f46dc7-ae6b-4c69-b8fb-898d9b509eb2 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:19 devstack sudo[86403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f46dc7-ae6b-4c69-b8fb-898d9b509eb2 1073741824
Apr 02 10:28:19 devstack sudo[86403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:19 devstack sudo[86401]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0" returned: 0 in 0.545s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0.07ce1adb-bebd-4f64-bd1e-da549641495b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:19 devstack sudo[86408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0.07ce1adb-bebd-4f64-bd1e-da549641495b
Apr 02 10:28:19 devstack sudo[86408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:19 devstack sudo[86403]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-55d354c3-7b97-4d81-a764-290ff3e9fcff tempest-VolumeQuotasNegativeTestJSON-590254786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f46dc7-ae6b-4c69-b8fb-898d9b509eb2 1073741824" returned: 0 in 0.486s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-55d354c3-7b97-4d81-a764-290ff3e9fcff tempest-VolumeQuotasNegativeTestJSON-590254786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f46dc7-ae6b-4c69-b8fb-898d9b509eb2 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:20 devstack sudo[86413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f46dc7-ae6b-4c69-b8fb-898d9b509eb2
Apr 02 10:28:20 devstack sudo[86413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:20 devstack sudo[86408]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0.07ce1adb-bebd-4f64-bd1e-da549641495b" returned: 0 in 0.577s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0.07ce1adb-bebd-4f64-bd1e-da549641495b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:20 devstack sudo[86438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0.07ce1adb-bebd-4f64-bd1e-da549641495b
Apr 02 10:28:20 devstack sudo[86438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:20 devstack sudo[86413]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-55d354c3-7b97-4d81-a764-290ff3e9fcff tempest-VolumeQuotasNegativeTestJSON-590254786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f46dc7-ae6b-4c69-b8fb-898d9b509eb2" returned: 0 in 0.678s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:20 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-55d354c3-7b97-4d81-a764-290ff3e9fcff tempest-VolumeQuotasNegativeTestJSON-590254786 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:28:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-55d354c3-7b97-4d81-a764-290ff3e9fcff tempest-VolumeQuotasNegativeTestJSON-590254786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:20 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-55d354c3-7b97-4d81-a764-290ff3e9fcff tempest-VolumeQuotasNegativeTestJSON-590254786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8b35104-ec1c-4214-a4d9-b099e379d915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0f46dc7-ae6b-4c69-b8fb-898d9b509eb2', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:20 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-55d354c3-7b97-4d81-a764-290ff3e9fcff tempest-VolumeQuotasNegativeTestJSON-590254786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80d99c97-80b8-40f4-af86-0891f7727ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:20 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-55d354c3-7b97-4d81-a764-290ff3e9fcff tempest-VolumeQuotasNegativeTestJSON-590254786 None] Volume volume-d0f46dc7-ae6b-4c69-b8fb-898d9b509eb2 (d0f46dc7-ae6b-4c69-b8fb-898d9b509eb2): created successfully
Apr 02 10:28:20 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-55d354c3-7b97-4d81-a764-290ff3e9fcff tempest-VolumeQuotasNegativeTestJSON-590254786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80d99c97-80b8-40f4-af86-0891f7727ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:20 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-55d354c3-7b97-4d81-a764-290ff3e9fcff tempest-VolumeQuotasNegativeTestJSON-590254786 None] Flow 'volume_create_manager' (10a0c0f2-410a-4b2b-ad3a-4e2a3816b3c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:28:20 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-55d354c3-7b97-4d81-a764-290ff3e9fcff tempest-VolumeQuotasNegativeTestJSON-590254786 None] Created volume successfully.
Apr 02 10:28:20 devstack sudo[86438]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0.07ce1adb-bebd-4f64-bd1e-da549641495b" returned: 0 in 0.561s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:20 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] Lock "cinder-quobyte-07ce1adb-bebd-4f64-bd1e-da549641495b" released by "_delete_snapshot" :: held 2.477s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:20 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] Lock "cinder-quobyte-14b501d3-558d-4666-a0f4-761b0ab45dc0" released by "delete_snapshot" :: held 2.490s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:20 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] Created reservations ['760f24ac-37be-4c7d-b249-04c9a0bacbca', 'acc12840-6b3f-4e76-a4a6-ce3b5c3c1f27', 'd5898ec3-3235-4902-8174-82c8f8d97a9b', '62533014-2a3f-4905-8e11-fb49a25528e9'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:28:21 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] Delete snapshot completed successfully.
Apr 02 10:28:21 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] Lock "cinder-07ce1adb-bebd-4f64-bd1e-da549641495b-delete_snapshot" released by "delete_snapshot" :: held 2.598s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:21 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] Snapshots deleted, issuing volume delete {{(pid=82102) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 02 10:28:21 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] Acquiring lock "cinder-quobyte-14b501d3-558d-4666-a0f4-761b0ab45dc0" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:21 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] Lock "cinder-quobyte-14b501d3-558d-4666-a0f4-761b0ab45dc0" acquired by "delete_volume" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:21 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2121d35e-7add-4dfb-8d18-100829c0b676]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:28:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:21 devstack sudo[86447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0
Apr 02 10:28:21 devstack sudo[86447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:21 devstack sudo[86447]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0" returned: 0 in 0.698s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:21 devstack sudo[86452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0
Apr 02 10:28:21 devstack sudo[86452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:22 devstack sudo[86452]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14b501d3-558d-4666-a0f4-761b0ab45dc0" returned: 0 in 0.556s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:22 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] Lock "cinder-quobyte-14b501d3-558d-4666-a0f4-761b0ab45dc0" released by "delete_volume" :: held 1.300s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:22 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] Created reservations ['cdff4d1d-31f1-4dae-9668-92a80abe7351', 'ccbd7d2d-86b0-4a30-bea9-dca132e77883', 'c05e9d5d-8ac9-4f74-9b06-8ff2a24bf6f8', '96fd7b74-b382-4004-b6ee-1239a96f5ca7'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:28:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:22 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:28:22 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:28:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:22 devstack sudo[86456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:28:22 devstack sudo[86456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:22 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a5aca727-c0a3-48fb-a92c-2f800fc0286d tempest-VolumeQuotasNegativeTestJSON-590254786 None] Acquiring lock "cinder-d0f46dc7-ae6b-4c69-b8fb-898d9b509eb2-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:22 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a5aca727-c0a3-48fb-a92c-2f800fc0286d tempest-VolumeQuotasNegativeTestJSON-590254786 None] Lock "cinder-d0f46dc7-ae6b-4c69-b8fb-898d9b509eb2-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:22 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a5aca727-c0a3-48fb-a92c-2f800fc0286d tempest-VolumeQuotasNegativeTestJSON-590254786 None] Acquiring lock "cinder-quobyte-d0f46dc7-ae6b-4c69-b8fb-898d9b509eb2" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:22 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a5aca727-c0a3-48fb-a92c-2f800fc0286d tempest-VolumeQuotasNegativeTestJSON-590254786 None] Lock "cinder-quobyte-d0f46dc7-ae6b-4c69-b8fb-898d9b509eb2" acquired by "delete_volume" :: waited 0.011s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:22 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd15b679-ce95-4001-9d07-96991aab0ca9]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:28:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a5aca727-c0a3-48fb-a92c-2f800fc0286d tempest-VolumeQuotasNegativeTestJSON-590254786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f46dc7-ae6b-4c69-b8fb-898d9b509eb2 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:22 devstack sudo[86458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f46dc7-ae6b-4c69-b8fb-898d9b509eb2
Apr 02 10:28:22 devstack sudo[86458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:22 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a9591d39-799d-4a25-99da-ee1781756942 tempest-VolumesDeleteCascade-1697419128 None] Acquiring lock "cinder-f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:22 devstack sudo[86456]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.507s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:22 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:28:22 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a9591d39-799d-4a25-99da-ee1781756942 tempest-VolumesDeleteCascade-1697419128 None] Lock "cinder-f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:22 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] Deleted volume successfully.
Apr 02 10:28:22 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-324dc9cf-f6ea-4b38-bfaf-7b99444a7eb2 tempest-VolumesDeleteCascade-1697419128 None] Lock "cinder-14b501d3-558d-4666-a0f4-761b0ab45dc0-delete_volume" released by "delete_volume" :: held 4.594s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:22 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a9591d39-799d-4a25-99da-ee1781756942 tempest-VolumesDeleteCascade-1697419128 None] Acquiring lock "cinder-quobyte-f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:23 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a9591d39-799d-4a25-99da-ee1781756942 tempest-VolumesDeleteCascade-1697419128 None] Lock "cinder-quobyte-f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4" acquired by "delete_volume" :: waited 0.012s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:23 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[21790efe-2ccd-4577-82f2-1f5d819ceb86]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:28:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a9591d39-799d-4a25-99da-ee1781756942 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:23 devstack sudo[86461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4
Apr 02 10:28:23 devstack sudo[86461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:23 devstack sudo[86458]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a5aca727-c0a3-48fb-a92c-2f800fc0286d tempest-VolumeQuotasNegativeTestJSON-590254786 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f46dc7-ae6b-4c69-b8fb-898d9b509eb2" returned: 0 in 0.663s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a5aca727-c0a3-48fb-a92c-2f800fc0286d tempest-VolumeQuotasNegativeTestJSON-590254786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f46dc7-ae6b-4c69-b8fb-898d9b509eb2 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:23 devstack sudo[86467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f46dc7-ae6b-4c69-b8fb-898d9b509eb2
Apr 02 10:28:23 devstack sudo[86467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:23 devstack sudo[86461]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a9591d39-799d-4a25-99da-ee1781756942 tempest-VolumesDeleteCascade-1697419128 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4" returned: 0 in 0.630s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a9591d39-799d-4a25-99da-ee1781756942 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:23 devstack sudo[86472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4
Apr 02 10:28:23 devstack sudo[86472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:23 devstack sudo[86467]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a5aca727-c0a3-48fb-a92c-2f800fc0286d tempest-VolumeQuotasNegativeTestJSON-590254786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f46dc7-ae6b-4c69-b8fb-898d9b509eb2" returned: 0 in 0.527s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:23 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a5aca727-c0a3-48fb-a92c-2f800fc0286d tempest-VolumeQuotasNegativeTestJSON-590254786 None] Lock "cinder-quobyte-d0f46dc7-ae6b-4c69-b8fb-898d9b509eb2" released by "delete_volume" :: held 1.235s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:23 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-a5aca727-c0a3-48fb-a92c-2f800fc0286d tempest-VolumeQuotasNegativeTestJSON-590254786 None] Created reservations ['031f6f3b-5f1e-4609-a459-b3dd4f9af0fe', 'aa157985-5bf0-4153-a27d-9b3602d3df63', 'c46b6ffd-039e-4b17-9608-fbe661ae05b6', '4d89c2fc-50e4-48de-beda-669e6516c0ea'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:28:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a5aca727-c0a3-48fb-a92c-2f800fc0286d tempest-VolumeQuotasNegativeTestJSON-590254786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a5aca727-c0a3-48fb-a92c-2f800fc0286d tempest-VolumeQuotasNegativeTestJSON-590254786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:23 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-a5aca727-c0a3-48fb-a92c-2f800fc0286d tempest-VolumeQuotasNegativeTestJSON-590254786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:28:24 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-a5aca727-c0a3-48fb-a92c-2f800fc0286d tempest-VolumeQuotasNegativeTestJSON-590254786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:28:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a5aca727-c0a3-48fb-a92c-2f800fc0286d tempest-VolumeQuotasNegativeTestJSON-590254786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a5aca727-c0a3-48fb-a92c-2f800fc0286d tempest-VolumeQuotasNegativeTestJSON-590254786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:24 devstack sudo[86475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:28:24 devstack sudo[86475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:24 devstack sudo[86472]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a9591d39-799d-4a25-99da-ee1781756942 tempest-VolumesDeleteCascade-1697419128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4" returned: 0 in 0.449s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:24 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a9591d39-799d-4a25-99da-ee1781756942 tempest-VolumesDeleteCascade-1697419128 None] Lock "cinder-quobyte-f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4" released by "delete_volume" :: held 1.113s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:24 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-a9591d39-799d-4a25-99da-ee1781756942 tempest-VolumesDeleteCascade-1697419128 None] Created reservations ['86220426-994f-4e7d-98d8-ff5e536cc27f', 'd0eb2507-0278-4fd1-921a-424b9450c10d', 'f2f126d9-9805-437c-be99-87dbbfe9f8ab', '068f09ba-b550-43c2-a217-22506039e3f7'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:28:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a9591d39-799d-4a25-99da-ee1781756942 tempest-VolumesDeleteCascade-1697419128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a9591d39-799d-4a25-99da-ee1781756942 tempest-VolumesDeleteCascade-1697419128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:24 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-a9591d39-799d-4a25-99da-ee1781756942 tempest-VolumesDeleteCascade-1697419128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:28:24 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-a9591d39-799d-4a25-99da-ee1781756942 tempest-VolumesDeleteCascade-1697419128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:28:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a9591d39-799d-4a25-99da-ee1781756942 tempest-VolumesDeleteCascade-1697419128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a9591d39-799d-4a25-99da-ee1781756942 tempest-VolumesDeleteCascade-1697419128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:24 devstack sudo[86478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:28:24 devstack sudo[86478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:24 devstack sudo[86475]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a5aca727-c0a3-48fb-a92c-2f800fc0286d tempest-VolumeQuotasNegativeTestJSON-590254786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.558s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:24 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-a5aca727-c0a3-48fb-a92c-2f800fc0286d tempest-VolumeQuotasNegativeTestJSON-590254786 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:28:24 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-a5aca727-c0a3-48fb-a92c-2f800fc0286d tempest-VolumeQuotasNegativeTestJSON-590254786 None] Deleted volume successfully.
Apr 02 10:28:24 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a5aca727-c0a3-48fb-a92c-2f800fc0286d tempest-VolumeQuotasNegativeTestJSON-590254786 None] Lock "cinder-d0f46dc7-ae6b-4c69-b8fb-898d9b509eb2-delete_volume" released by "delete_volume" :: held 1.987s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:24 devstack sudo[86478]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a9591d39-799d-4a25-99da-ee1781756942 tempest-VolumesDeleteCascade-1697419128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.493s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:24 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-a9591d39-799d-4a25-99da-ee1781756942 tempest-VolumesDeleteCascade-1697419128 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:28:24 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-a9591d39-799d-4a25-99da-ee1781756942 tempest-VolumesDeleteCascade-1697419128 None] Deleted volume successfully.
Apr 02 10:28:24 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a9591d39-799d-4a25-99da-ee1781756942 tempest-VolumesDeleteCascade-1697419128 None] Lock "cinder-f90cf7fd-392e-4b95-9fd8-8e57ed75b1a4-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:24 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c6c8345-07e3-44b4-b1a6-9a8a510fe3d5 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:28:24 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-6c6c8345-07e3-44b4-b1a6-9a8a510fe3d5 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Flow 'volume_create_manager' (3acfee40-b9a3-4409-9bc5-ad5b9b0c70d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:28:24 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-6c6c8345-07e3-44b4-b1a6-9a8a510fe3d5 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f1d4e13-b9c0-466a-aa63-115de1651c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:24 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-6c6c8345-07e3-44b4-b1a6-9a8a510fe3d5 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f1d4e13-b9c0-466a-aa63-115de1651c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-994458801',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d0dbb4-7b6b-4298-9380-10cd39b4eefc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09044b37a7af4f5390cd9189c75d7c4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:28:25Z,use_quota=True,user_id='92240c6750ff42859295c2d1035c1b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b99f796-55be-445a-9601-8685ea8d48f1),volume_type_id=1b99f796-55be-445a-9601-8685ea8d48f1)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:24 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-6c6c8345-07e3-44b4-b1a6-9a8a510fe3d5 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ecaa580-01e7-475b-a0b0-cc1e4496b3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:24 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-6c6c8345-07e3-44b4-b1a6-9a8a510fe3d5 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ecaa580-01e7-475b-a0b0-cc1e4496b3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:24 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-6c6c8345-07e3-44b4-b1a6-9a8a510fe3d5 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a657d20-a163-46ef-b121-f814f19b1665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:24 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-6c6c8345-07e3-44b4-b1a6-9a8a510fe3d5 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a657d20-a163-46ef-b121-f814f19b1665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48d0dbb4-7b6b-4298-9380-10cd39b4eefc', 'volume_name': 'volume-48d0dbb4-7b6b-4298-9380-10cd39b4eefc', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:24 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-6c6c8345-07e3-44b4-b1a6-9a8a510fe3d5 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb0b46a-9790-4fc0-b67b-77bf63f5dbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:24 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-6c6c8345-07e3-44b4-b1a6-9a8a510fe3d5 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb0b46a-9790-4fc0-b67b-77bf63f5dbad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:24 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-6c6c8345-07e3-44b4-b1a6-9a8a510fe3d5 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c2e8a6f-b3bb-410d-aa76-9bba32e7d3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:24 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-6c6c8345-07e3-44b4-b1a6-9a8a510fe3d5 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Volume 48d0dbb4-7b6b-4298-9380-10cd39b4eefc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48d0dbb4-7b6b-4298-9380-10cd39b4eefc', 'volume_size': 1}
Apr 02 10:28:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-6c6c8345-07e3-44b4-b1a6-9a8a510fe3d5 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-6c6c8345-07e3-44b4-b1a6-9a8a510fe3d5 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:24 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-6c6c8345-07e3-44b4-b1a6-9a8a510fe3d5 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-994458801',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d0dbb4-7b6b-4298-9380-10cd39b4eefc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09044b37a7af4f5390cd9189c75d7c4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:28:25Z,use_quota=True,user_id='92240c6750ff42859295c2d1035c1b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b99f796-55be-445a-9601-8685ea8d48f1),volume_type_id=1b99f796-55be-445a-9601-8685ea8d48f1)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:28:24 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-6c6c8345-07e3-44b4-b1a6-9a8a510fe3d5 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Creating volume 48d0dbb4-7b6b-4298-9380-10cd39b4eefc {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:28:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-6c6c8345-07e3-44b4-b1a6-9a8a510fe3d5 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-6c6c8345-07e3-44b4-b1a6-9a8a510fe3d5 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:24 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-6c6c8345-07e3-44b4-b1a6-9a8a510fe3d5 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:28:25 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-6c6c8345-07e3-44b4-b1a6-9a8a510fe3d5 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:28:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-6c6c8345-07e3-44b4-b1a6-9a8a510fe3d5 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:25 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-6c6c8345-07e3-44b4-b1a6-9a8a510fe3d5 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:28:25 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-6c6c8345-07e3-44b4-b1a6-9a8a510fe3d5 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:28:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6c6c8345-07e3-44b4-b1a6-9a8a510fe3d5 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48d0dbb4-7b6b-4298-9380-10cd39b4eefc 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:25 devstack sudo[86482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48d0dbb4-7b6b-4298-9380-10cd39b4eefc 1073741824
Apr 02 10:28:25 devstack sudo[86482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:25 devstack sudo[86482]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6c6c8345-07e3-44b4-b1a6-9a8a510fe3d5 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48d0dbb4-7b6b-4298-9380-10cd39b4eefc 1073741824" returned: 0 in 0.742s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6c6c8345-07e3-44b4-b1a6-9a8a510fe3d5 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48d0dbb4-7b6b-4298-9380-10cd39b4eefc {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:25 devstack sudo[86487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48d0dbb4-7b6b-4298-9380-10cd39b4eefc
Apr 02 10:28:25 devstack sudo[86487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:26 devstack sudo[86487]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6c6c8345-07e3-44b4-b1a6-9a8a510fe3d5 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48d0dbb4-7b6b-4298-9380-10cd39b4eefc" returned: 0 in 0.644s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:26 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-6c6c8345-07e3-44b4-b1a6-9a8a510fe3d5 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] <== create_volume: return (1425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:28:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-6c6c8345-07e3-44b4-b1a6-9a8a510fe3d5 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:26 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-6c6c8345-07e3-44b4-b1a6-9a8a510fe3d5 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c2e8a6f-b3bb-410d-aa76-9bba32e7d3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48d0dbb4-7b6b-4298-9380-10cd39b4eefc', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:26 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-6c6c8345-07e3-44b4-b1a6-9a8a510fe3d5 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7892d786-8fa8-4d7e-a7ee-4ac3c5308477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:26 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-6c6c8345-07e3-44b4-b1a6-9a8a510fe3d5 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Volume volume-48d0dbb4-7b6b-4298-9380-10cd39b4eefc (48d0dbb4-7b6b-4298-9380-10cd39b4eefc): created successfully
Apr 02 10:28:26 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-6c6c8345-07e3-44b4-b1a6-9a8a510fe3d5 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7892d786-8fa8-4d7e-a7ee-4ac3c5308477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:26 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-6c6c8345-07e3-44b4-b1a6-9a8a510fe3d5 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Flow 'volume_create_manager' (3acfee40-b9a3-4409-9bc5-ad5b9b0c70d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:28:26 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-6c6c8345-07e3-44b4-b1a6-9a8a510fe3d5 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Created volume successfully.
Apr 02 10:28:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d1768820-eaa0-489b-8553-0d8fd1106db9 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d1768820-eaa0-489b-8553-0d8fd1106db9 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:27 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d1768820-eaa0-489b-8553-0d8fd1106db9 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:28:27 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d1768820-eaa0-489b-8553-0d8fd1106db9 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:28:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d1768820-eaa0-489b-8553-0d8fd1106db9 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d1768820-eaa0-489b-8553-0d8fd1106db9 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:27 devstack sudo[86491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:28:27 devstack sudo[86491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:28 devstack sudo[86491]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d1768820-eaa0-489b-8553-0d8fd1106db9 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.595s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:28 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-d1768820-eaa0-489b-8553-0d8fd1106db9 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:28:28 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-d1768820-eaa0-489b-8553-0d8fd1106db9 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Retype volume completed successfully.
Apr 02 10:28:28 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-018fbb37-4e65-4785-bdaf-ada529ac2b1a tempest-VolumesTransfersV357Test-1237892236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:28:28 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-018fbb37-4e65-4785-bdaf-ada529ac2b1a tempest-VolumesTransfersV357Test-1237892236 None] Flow 'volume_create_manager' (9f31013a-4fa7-4612-8127-f10d6a0a4cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:28:28 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-018fbb37-4e65-4785-bdaf-ada529ac2b1a tempest-VolumesTransfersV357Test-1237892236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc085493-d6f0-430a-a662-052cc6f42e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:28 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-cdcf76e8-5c83-414a-a1ec-0cb9733611a0 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Acquiring lock "cinder-48d0dbb4-7b6b-4298-9380-10cd39b4eefc-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:28 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-018fbb37-4e65-4785-bdaf-ada529ac2b1a tempest-VolumesTransfersV357Test-1237892236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc085493-d6f0-430a-a662-052cc6f42e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1026873827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14cfc37f-bdbf-45f1-b656-090811b8d6a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9334b26102ba47b0872149473db6fad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:28:29Z,use_quota=True,user_id='0a989f83a5474c65ad642094f1d767b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:28 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-018fbb37-4e65-4785-bdaf-ada529ac2b1a tempest-VolumesTransfersV357Test-1237892236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b6ab6e-6cd8-40d3-8451-7503673f6284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:28 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-018fbb37-4e65-4785-bdaf-ada529ac2b1a tempest-VolumesTransfersV357Test-1237892236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b6ab6e-6cd8-40d3-8451-7503673f6284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:28 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-018fbb37-4e65-4785-bdaf-ada529ac2b1a tempest-VolumesTransfersV357Test-1237892236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f862d4a-d925-4892-a34e-8dbaf573279e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:28 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-018fbb37-4e65-4785-bdaf-ada529ac2b1a tempest-VolumesTransfersV357Test-1237892236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f862d4a-d925-4892-a34e-8dbaf573279e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14cfc37f-bdbf-45f1-b656-090811b8d6a8', 'volume_name': 'volume-14cfc37f-bdbf-45f1-b656-090811b8d6a8', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:28 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-018fbb37-4e65-4785-bdaf-ada529ac2b1a tempest-VolumesTransfersV357Test-1237892236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a56382-0270-4cf2-b119-c63a759bddd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:28 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-018fbb37-4e65-4785-bdaf-ada529ac2b1a tempest-VolumesTransfersV357Test-1237892236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a56382-0270-4cf2-b119-c63a759bddd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:28 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-018fbb37-4e65-4785-bdaf-ada529ac2b1a tempest-VolumesTransfersV357Test-1237892236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a536a5d-c588-477b-a6b0-fffee59f2019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:28 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-018fbb37-4e65-4785-bdaf-ada529ac2b1a tempest-VolumesTransfersV357Test-1237892236 None] Volume 14cfc37f-bdbf-45f1-b656-090811b8d6a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14cfc37f-bdbf-45f1-b656-090811b8d6a8', 'volume_size': 1}
Apr 02 10:28:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-018fbb37-4e65-4785-bdaf-ada529ac2b1a tempest-VolumesTransfersV357Test-1237892236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-018fbb37-4e65-4785-bdaf-ada529ac2b1a tempest-VolumesTransfersV357Test-1237892236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:28 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-018fbb37-4e65-4785-bdaf-ada529ac2b1a tempest-VolumesTransfersV357Test-1237892236 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1026873827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14cfc37f-bdbf-45f1-b656-090811b8d6a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9334b26102ba47b0872149473db6fad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:28:29Z,use_quota=True,user_id='0a989f83a5474c65ad642094f1d767b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:28:28 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-018fbb37-4e65-4785-bdaf-ada529ac2b1a tempest-VolumesTransfersV357Test-1237892236 None] Creating volume 14cfc37f-bdbf-45f1-b656-090811b8d6a8 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:28:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-018fbb37-4e65-4785-bdaf-ada529ac2b1a tempest-VolumesTransfersV357Test-1237892236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-018fbb37-4e65-4785-bdaf-ada529ac2b1a tempest-VolumesTransfersV357Test-1237892236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:28 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-018fbb37-4e65-4785-bdaf-ada529ac2b1a tempest-VolumesTransfersV357Test-1237892236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:28:28 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-018fbb37-4e65-4785-bdaf-ada529ac2b1a tempest-VolumesTransfersV357Test-1237892236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:28:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-018fbb37-4e65-4785-bdaf-ada529ac2b1a tempest-VolumesTransfersV357Test-1237892236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:28 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-018fbb37-4e65-4785-bdaf-ada529ac2b1a tempest-VolumesTransfersV357Test-1237892236 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:28:28 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-018fbb37-4e65-4785-bdaf-ada529ac2b1a tempest-VolumesTransfersV357Test-1237892236 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:28:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-018fbb37-4e65-4785-bdaf-ada529ac2b1a tempest-VolumesTransfersV357Test-1237892236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14cfc37f-bdbf-45f1-b656-090811b8d6a8 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:28 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-cdcf76e8-5c83-414a-a1ec-0cb9733611a0 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Lock "cinder-48d0dbb4-7b6b-4298-9380-10cd39b4eefc-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:28 devstack sudo[86496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14cfc37f-bdbf-45f1-b656-090811b8d6a8 1073741824
Apr 02 10:28:28 devstack sudo[86496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:28 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-cdcf76e8-5c83-414a-a1ec-0cb9733611a0 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Acquiring lock "cinder-quobyte-48d0dbb4-7b6b-4298-9380-10cd39b4eefc" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:28 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-cdcf76e8-5c83-414a-a1ec-0cb9733611a0 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Lock "cinder-quobyte-48d0dbb4-7b6b-4298-9380-10cd39b4eefc" acquired by "delete_volume" :: waited 0.011s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:28 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a619c1e3-acf1-4488-b1b7-570380c28946]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:28:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cdcf76e8-5c83-414a-a1ec-0cb9733611a0 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48d0dbb4-7b6b-4298-9380-10cd39b4eefc {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:29 devstack sudo[86498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48d0dbb4-7b6b-4298-9380-10cd39b4eefc
Apr 02 10:28:29 devstack sudo[86498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:29 devstack sudo[86496]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-018fbb37-4e65-4785-bdaf-ada529ac2b1a tempest-VolumesTransfersV357Test-1237892236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14cfc37f-bdbf-45f1-b656-090811b8d6a8 1073741824" returned: 0 in 0.615s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-018fbb37-4e65-4785-bdaf-ada529ac2b1a tempest-VolumesTransfersV357Test-1237892236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14cfc37f-bdbf-45f1-b656-090811b8d6a8 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:29 devstack sudo[86503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14cfc37f-bdbf-45f1-b656-090811b8d6a8
Apr 02 10:28:29 devstack sudo[86503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:29 devstack sudo[86498]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cdcf76e8-5c83-414a-a1ec-0cb9733611a0 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48d0dbb4-7b6b-4298-9380-10cd39b4eefc" returned: 0 in 0.846s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cdcf76e8-5c83-414a-a1ec-0cb9733611a0 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48d0dbb4-7b6b-4298-9380-10cd39b4eefc {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:29 devstack sudo[86509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48d0dbb4-7b6b-4298-9380-10cd39b4eefc
Apr 02 10:28:29 devstack sudo[86509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:30 devstack sudo[86503]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-018fbb37-4e65-4785-bdaf-ada529ac2b1a tempest-VolumesTransfersV357Test-1237892236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14cfc37f-bdbf-45f1-b656-090811b8d6a8" returned: 0 in 0.704s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:30 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-018fbb37-4e65-4785-bdaf-ada529ac2b1a tempest-VolumesTransfersV357Test-1237892236 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:28:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-018fbb37-4e65-4785-bdaf-ada529ac2b1a tempest-VolumesTransfersV357Test-1237892236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:30 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-018fbb37-4e65-4785-bdaf-ada529ac2b1a tempest-VolumesTransfersV357Test-1237892236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a536a5d-c588-477b-a6b0-fffee59f2019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14cfc37f-bdbf-45f1-b656-090811b8d6a8', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:30 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-018fbb37-4e65-4785-bdaf-ada529ac2b1a tempest-VolumesTransfersV357Test-1237892236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c1b6e13-66e9-40f1-8534-856843ea012e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:30 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-018fbb37-4e65-4785-bdaf-ada529ac2b1a tempest-VolumesTransfersV357Test-1237892236 None] Volume volume-14cfc37f-bdbf-45f1-b656-090811b8d6a8 (14cfc37f-bdbf-45f1-b656-090811b8d6a8): created successfully
Apr 02 10:28:30 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-018fbb37-4e65-4785-bdaf-ada529ac2b1a tempest-VolumesTransfersV357Test-1237892236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c1b6e13-66e9-40f1-8534-856843ea012e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:30 devstack sudo[86509]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:30 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-018fbb37-4e65-4785-bdaf-ada529ac2b1a tempest-VolumesTransfersV357Test-1237892236 None] Flow 'volume_create_manager' (9f31013a-4fa7-4612-8127-f10d6a0a4cb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:28:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cdcf76e8-5c83-414a-a1ec-0cb9733611a0 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48d0dbb4-7b6b-4298-9380-10cd39b4eefc" returned: 0 in 0.488s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:30 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-cdcf76e8-5c83-414a-a1ec-0cb9733611a0 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Lock "cinder-quobyte-48d0dbb4-7b6b-4298-9380-10cd39b4eefc" released by "delete_volume" :: held 1.360s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:30 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-018fbb37-4e65-4785-bdaf-ada529ac2b1a tempest-VolumesTransfersV357Test-1237892236 None] Created volume successfully.
Apr 02 10:28:30 devstack cinder-volume[82102]: WARNING cinder.quota [None req-cdcf76e8-5c83-414a-a1ec-0cb9733611a0 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 02 10:28:30 devstack cinder-volume[82102]: WARNING cinder.quota [None req-cdcf76e8-5c83-414a-a1ec-0cb9733611a0 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 02 10:28:30 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-cdcf76e8-5c83-414a-a1ec-0cb9733611a0 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Created reservations ['ad6d5942-a4c5-42aa-8f22-d05f9058f5de', '536e707a-9da2-449a-b8c6-d5d75ecb3de7', 'ce23a435-4599-44a2-a8b3-e5f63863a02f', '2df6ca80-6ecd-4d96-b665-97bb9651b895'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:28:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-cdcf76e8-5c83-414a-a1ec-0cb9733611a0 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-cdcf76e8-5c83-414a-a1ec-0cb9733611a0 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:30 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-cdcf76e8-5c83-414a-a1ec-0cb9733611a0 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:28:30 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-cdcf76e8-5c83-414a-a1ec-0cb9733611a0 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:28:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-cdcf76e8-5c83-414a-a1ec-0cb9733611a0 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cdcf76e8-5c83-414a-a1ec-0cb9733611a0 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:30 devstack sudo[86513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:28:30 devstack sudo[86513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:30 devstack sudo[86513]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cdcf76e8-5c83-414a-a1ec-0cb9733611a0 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.578s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:30 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-cdcf76e8-5c83-414a-a1ec-0cb9733611a0 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:28:31 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-cdcf76e8-5c83-414a-a1ec-0cb9733611a0 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Deleted volume successfully.
Apr 02 10:28:31 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-cdcf76e8-5c83-414a-a1ec-0cb9733611a0 tempest-VolumeRetypeWithoutMigrationTest-1446974904 None] Lock "cinder-48d0dbb4-7b6b-4298-9380-10cd39b4eefc-delete_volume" released by "delete_volume" :: held 2.122s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:31 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-b087f1d5-42fa-42fd-a4b8-d57a16d97d31 tempest-VolumesTransfersV357Test-1446294335 None] Transfer volume completed successfully.
Apr 02 10:28:32 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-dce751b4-b349-4613-b716-7f62665d1cc2 tempest-VolumesTransfersV357Test-1637088910 None] Acquiring lock "cinder-14cfc37f-bdbf-45f1-b656-090811b8d6a8-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:32 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-dce751b4-b349-4613-b716-7f62665d1cc2 tempest-VolumesTransfersV357Test-1637088910 None] Lock "cinder-14cfc37f-bdbf-45f1-b656-090811b8d6a8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:32 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-dce751b4-b349-4613-b716-7f62665d1cc2 tempest-VolumesTransfersV357Test-1637088910 None] Acquiring lock "cinder-quobyte-14cfc37f-bdbf-45f1-b656-090811b8d6a8" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:32 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-dce751b4-b349-4613-b716-7f62665d1cc2 tempest-VolumesTransfersV357Test-1637088910 None] Lock "cinder-quobyte-14cfc37f-bdbf-45f1-b656-090811b8d6a8" acquired by "delete_volume" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:32 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d13680-bd0c-432d-acd1-87a06064ecd7]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:28:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-dce751b4-b349-4613-b716-7f62665d1cc2 tempest-VolumesTransfersV357Test-1637088910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14cfc37f-bdbf-45f1-b656-090811b8d6a8 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:32 devstack sudo[86517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14cfc37f-bdbf-45f1-b656-090811b8d6a8
Apr 02 10:28:32 devstack sudo[86517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:33 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-d2570d59-bfe2-4a06-9b73-31fc3531ea33 tempest-GroupSnapshotsTest-773077248 None] Group tempest-GroupSnapshotsTest-Group-1742509775: creating
Apr 02 10:28:33 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-d2570d59-bfe2-4a06-9b73-31fc3531ea33 tempest-GroupSnapshotsTest-773077248 None] Group tempest-GroupSnapshotsTest-Group-1742509775: created successfully
Apr 02 10:28:33 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-d2570d59-bfe2-4a06-9b73-31fc3531ea33 tempest-GroupSnapshotsTest-773077248 None] Create group completed successfully.
Apr 02 10:28:33 devstack sudo[86517]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-dce751b4-b349-4613-b716-7f62665d1cc2 tempest-VolumesTransfersV357Test-1637088910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14cfc37f-bdbf-45f1-b656-090811b8d6a8" returned: 0 in 0.737s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-dce751b4-b349-4613-b716-7f62665d1cc2 tempest-VolumesTransfersV357Test-1637088910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14cfc37f-bdbf-45f1-b656-090811b8d6a8 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:33 devstack sudo[86522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14cfc37f-bdbf-45f1-b656-090811b8d6a8
Apr 02 10:28:33 devstack sudo[86522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:34 devstack sudo[86522]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-dce751b4-b349-4613-b716-7f62665d1cc2 tempest-VolumesTransfersV357Test-1637088910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-14cfc37f-bdbf-45f1-b656-090811b8d6a8" returned: 0 in 0.605s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:34 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-dce751b4-b349-4613-b716-7f62665d1cc2 tempest-VolumesTransfersV357Test-1637088910 None] Lock "cinder-quobyte-14cfc37f-bdbf-45f1-b656-090811b8d6a8" released by "delete_volume" :: held 1.380s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:34 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-dce751b4-b349-4613-b716-7f62665d1cc2 tempest-VolumesTransfersV357Test-1637088910 None] Created reservations ['53d673d3-d4f0-43be-b80a-bf571a18fa8c', '9b738522-3c9b-462c-8465-7719518b82a0', '7616b9d2-792d-460a-bf1f-246ecaa51e74', 'a14ddd4d-be2e-49a9-a922-14d3ec6bbd5b'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:28:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-dce751b4-b349-4613-b716-7f62665d1cc2 tempest-VolumesTransfersV357Test-1637088910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-dce751b4-b349-4613-b716-7f62665d1cc2 tempest-VolumesTransfersV357Test-1637088910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:34 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-dce751b4-b349-4613-b716-7f62665d1cc2 tempest-VolumesTransfersV357Test-1637088910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:28:34 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-dce751b4-b349-4613-b716-7f62665d1cc2 tempest-VolumesTransfersV357Test-1637088910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:28:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-dce751b4-b349-4613-b716-7f62665d1cc2 tempest-VolumesTransfersV357Test-1637088910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-dce751b4-b349-4613-b716-7f62665d1cc2 tempest-VolumesTransfersV357Test-1637088910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:34 devstack sudo[86525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:28:34 devstack sudo[86525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:34 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-e19cd574-282d-4167-a387-ca1584ad35c3 tempest-GroupSnapshotsTest-773077248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:28:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e19cd574-282d-4167-a387-ca1584ad35c3 tempest-GroupSnapshotsTest-773077248 None] Flow 'volume_create_manager' (52c23bdc-c532-46fd-9553-c162870f5763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:28:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e19cd574-282d-4167-a387-ca1584ad35c3 tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c46da2-ed3b-4266-a79f-1246be13d7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e19cd574-282d-4167-a387-ca1584ad35c3 tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c46da2-ed3b-4266-a79f-1246be13d7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1886601119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=dfc1cc71-af86-4acc-b385-6aa42d290889,host='devstack@QuobyteHD#QuobyteHD',id=c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='715df5a8413948c3abcecf488c7f9810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:28:35Z,use_quota=True,user_id='59fae1ac304a413883534cd7e39c3820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e438f179-229b-4e22-a6ab-90b0811c00ac),volume_type_id=e438f179-229b-4e22-a6ab-90b0811c00ac)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e19cd574-282d-4167-a387-ca1584ad35c3 tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e7bc77-2e80-4645-bd51-aa338dafc221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e19cd574-282d-4167-a387-ca1584ad35c3 tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e7bc77-2e80-4645-bd51-aa338dafc221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e19cd574-282d-4167-a387-ca1584ad35c3 tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9785e0f6-f06c-4623-8d5a-7c675613b21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e19cd574-282d-4167-a387-ca1584ad35c3 tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9785e0f6-f06c-4623-8d5a-7c675613b21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b', 'volume_name': 'volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e19cd574-282d-4167-a387-ca1584ad35c3 tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5d9669a-57e9-434f-8feb-a9cd30e28c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e19cd574-282d-4167-a387-ca1584ad35c3 tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5d9669a-57e9-434f-8feb-a9cd30e28c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e19cd574-282d-4167-a387-ca1584ad35c3 tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (976efe4b-a60a-4fc9-8588-42e3f635d2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:34 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-e19cd574-282d-4167-a387-ca1584ad35c3 tempest-GroupSnapshotsTest-773077248 None] Volume c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b', 'volume_size': 1}
Apr 02 10:28:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e19cd574-282d-4167-a387-ca1584ad35c3 tempest-GroupSnapshotsTest-773077248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e19cd574-282d-4167-a387-ca1584ad35c3 tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:34 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e19cd574-282d-4167-a387-ca1584ad35c3 tempest-GroupSnapshotsTest-773077248 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=dfc1cc71-af86-4acc-b385-6aa42d290889,created_at=2026-04-02T08:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1886601119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=dfc1cc71-af86-4acc-b385-6aa42d290889,host='devstack@QuobyteHD#QuobyteHD',id=c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='715df5a8413948c3abcecf488c7f9810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:28:35Z,use_quota=True,user_id='59fae1ac304a413883534cd7e39c3820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e438f179-229b-4e22-a6ab-90b0811c00ac),volume_type_id=e438f179-229b-4e22-a6ab-90b0811c00ac)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:28:34 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-e19cd574-282d-4167-a387-ca1584ad35c3 tempest-GroupSnapshotsTest-773077248 None] Creating volume c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:28:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e19cd574-282d-4167-a387-ca1584ad35c3 tempest-GroupSnapshotsTest-773077248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e19cd574-282d-4167-a387-ca1584ad35c3 tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:34 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e19cd574-282d-4167-a387-ca1584ad35c3 tempest-GroupSnapshotsTest-773077248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:28:34 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e19cd574-282d-4167-a387-ca1584ad35c3 tempest-GroupSnapshotsTest-773077248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:28:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e19cd574-282d-4167-a387-ca1584ad35c3 tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:34 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e19cd574-282d-4167-a387-ca1584ad35c3 tempest-GroupSnapshotsTest-773077248 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:28:34 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-e19cd574-282d-4167-a387-ca1584ad35c3 tempest-GroupSnapshotsTest-773077248 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:28:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e19cd574-282d-4167-a387-ca1584ad35c3 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:34 devstack sudo[86527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b 1073741824
Apr 02 10:28:34 devstack sudo[86527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:34 devstack sudo[86525]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-dce751b4-b349-4613-b716-7f62665d1cc2 tempest-VolumesTransfersV357Test-1637088910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.592s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:34 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-dce751b4-b349-4613-b716-7f62665d1cc2 tempest-VolumesTransfersV357Test-1637088910 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:28:34 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-dce751b4-b349-4613-b716-7f62665d1cc2 tempest-VolumesTransfersV357Test-1637088910 None] Deleted volume successfully.
Apr 02 10:28:34 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-dce751b4-b349-4613-b716-7f62665d1cc2 tempest-VolumesTransfersV357Test-1637088910 None] Lock "cinder-14cfc37f-bdbf-45f1-b656-090811b8d6a8-delete_volume" released by "delete_volume" :: held 2.157s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:35 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-92bcd625-9f0d-4d2d-a792-2a168b60c84e tempest-VolumesTransfersV357Test-1237892236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:28:35 devstack sudo[86527]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:35 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-92bcd625-9f0d-4d2d-a792-2a168b60c84e tempest-VolumesTransfersV357Test-1237892236 None] Flow 'volume_create_manager' (ff280db3-d2ae-48a5-85c7-b895e5387d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:28:35 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-92bcd625-9f0d-4d2d-a792-2a168b60c84e tempest-VolumesTransfersV357Test-1237892236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc09229-ae8d-4d30-af38-c3164524f635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e19cd574-282d-4167-a387-ca1584ad35c3 tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b 1073741824" returned: 0 in 0.676s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:35 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-92bcd625-9f0d-4d2d-a792-2a168b60c84e tempest-VolumesTransfersV357Test-1237892236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc09229-ae8d-4d30-af38-c3164524f635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-974403190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec59c21a-14ba-4038-bfe4-60a18e1f64bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9334b26102ba47b0872149473db6fad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:28:35Z,use_quota=True,user_id='0a989f83a5474c65ad642094f1d767b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:35 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-92bcd625-9f0d-4d2d-a792-2a168b60c84e tempest-VolumesTransfersV357Test-1237892236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e1b15a2-bfb8-44f4-848b-a4cb93e144c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:35 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-92bcd625-9f0d-4d2d-a792-2a168b60c84e tempest-VolumesTransfersV357Test-1237892236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e1b15a2-bfb8-44f4-848b-a4cb93e144c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:35 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-92bcd625-9f0d-4d2d-a792-2a168b60c84e tempest-VolumesTransfersV357Test-1237892236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe607e5a-cb68-4b53-ae19-987359f8528e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:35 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-92bcd625-9f0d-4d2d-a792-2a168b60c84e tempest-VolumesTransfersV357Test-1237892236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe607e5a-cb68-4b53-ae19-987359f8528e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec59c21a-14ba-4038-bfe4-60a18e1f64bc', 'volume_name': 'volume-ec59c21a-14ba-4038-bfe4-60a18e1f64bc', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:35 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-92bcd625-9f0d-4d2d-a792-2a168b60c84e tempest-VolumesTransfersV357Test-1237892236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebfc0ec1-34ce-45e7-91de-1b812c270767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:35 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-92bcd625-9f0d-4d2d-a792-2a168b60c84e tempest-VolumesTransfersV357Test-1237892236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebfc0ec1-34ce-45e7-91de-1b812c270767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:35 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-92bcd625-9f0d-4d2d-a792-2a168b60c84e tempest-VolumesTransfersV357Test-1237892236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a439d931-c888-43dc-ac62-076a2d866504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:35 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-92bcd625-9f0d-4d2d-a792-2a168b60c84e tempest-VolumesTransfersV357Test-1237892236 None] Volume ec59c21a-14ba-4038-bfe4-60a18e1f64bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec59c21a-14ba-4038-bfe4-60a18e1f64bc', 'volume_size': 1}
Apr 02 10:28:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-92bcd625-9f0d-4d2d-a792-2a168b60c84e tempest-VolumesTransfersV357Test-1237892236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e19cd574-282d-4167-a387-ca1584ad35c3 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:35 devstack sudo[86533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b
Apr 02 10:28:35 devstack sudo[86533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:35 devstack sudo[86533]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e19cd574-282d-4167-a387-ca1584ad35c3 tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b" returned: 0 in 0.509s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:35 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e19cd574-282d-4167-a387-ca1584ad35c3 tempest-GroupSnapshotsTest-773077248 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:28:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e19cd574-282d-4167-a387-ca1584ad35c3 tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-92bcd625-9f0d-4d2d-a792-2a168b60c84e tempest-VolumesTransfersV357Test-1237892236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.529s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:35 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-92bcd625-9f0d-4d2d-a792-2a168b60c84e tempest-VolumesTransfersV357Test-1237892236 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-974403190',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec59c21a-14ba-4038-bfe4-60a18e1f64bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9334b26102ba47b0872149473db6fad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:28:35Z,use_quota=True,user_id='0a989f83a5474c65ad642094f1d767b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:28:35 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-92bcd625-9f0d-4d2d-a792-2a168b60c84e tempest-VolumesTransfersV357Test-1237892236 None] Creating volume ec59c21a-14ba-4038-bfe4-60a18e1f64bc {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:28:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-92bcd625-9f0d-4d2d-a792-2a168b60c84e tempest-VolumesTransfersV357Test-1237892236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-92bcd625-9f0d-4d2d-a792-2a168b60c84e tempest-VolumesTransfersV357Test-1237892236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:35 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-92bcd625-9f0d-4d2d-a792-2a168b60c84e tempest-VolumesTransfersV357Test-1237892236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:28:35 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-92bcd625-9f0d-4d2d-a792-2a168b60c84e tempest-VolumesTransfersV357Test-1237892236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:28:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-92bcd625-9f0d-4d2d-a792-2a168b60c84e tempest-VolumesTransfersV357Test-1237892236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:35 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-92bcd625-9f0d-4d2d-a792-2a168b60c84e tempest-VolumesTransfersV357Test-1237892236 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:28:35 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-92bcd625-9f0d-4d2d-a792-2a168b60c84e tempest-VolumesTransfersV357Test-1237892236 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:28:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-92bcd625-9f0d-4d2d-a792-2a168b60c84e tempest-VolumesTransfersV357Test-1237892236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-ec59c21a-14ba-4038-bfe4-60a18e1f64bc 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:35 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e19cd574-282d-4167-a387-ca1584ad35c3 tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (976efe4b-a60a-4fc9-8588-42e3f635d2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:35 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e19cd574-282d-4167-a387-ca1584ad35c3 tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d9dfb2-cfa4-481a-8ce3-91b9250d5fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:36 devstack sudo[86536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-ec59c21a-14ba-4038-bfe4-60a18e1f64bc 1073741824
Apr 02 10:28:36 devstack sudo[86536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:36 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-e19cd574-282d-4167-a387-ca1584ad35c3 tempest-GroupSnapshotsTest-773077248 None] Volume volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b (c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b): created successfully
Apr 02 10:28:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e19cd574-282d-4167-a387-ca1584ad35c3 tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d9dfb2-cfa4-481a-8ce3-91b9250d5fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e19cd574-282d-4167-a387-ca1584ad35c3 tempest-GroupSnapshotsTest-773077248 None] Flow 'volume_create_manager' (52c23bdc-c532-46fd-9553-c162870f5763) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:28:36 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-e19cd574-282d-4167-a387-ca1584ad35c3 tempest-GroupSnapshotsTest-773077248 None] Created volume successfully.
Apr 02 10:28:36 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-969501d9-d7e5-4716-b183-987153939744 tempest-VolumesServicesTestJSON-658573965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:28:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-969501d9-d7e5-4716-b183-987153939744 tempest-VolumesServicesTestJSON-658573965 None] Flow 'volume_create_manager' (6770a14a-3bd4-4eeb-84a2-5af6f9506399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:28:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-969501d9-d7e5-4716-b183-987153939744 tempest-VolumesServicesTestJSON-658573965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a53797c2-e202-4cbf-add3-113abb2628b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-969501d9-d7e5-4716-b183-987153939744 tempest-VolumesServicesTestJSON-658573965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a53797c2-e202-4cbf-add3-113abb2628b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-751453370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa4daab9-5ce4-4c6d-b6d9-483e84727ffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d7e4f6600548ff87a478656ebb9c73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:28:36Z,use_quota=True,user_id='27923e6e42f24958b9e420d1b5c88971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-969501d9-d7e5-4716-b183-987153939744 tempest-VolumesServicesTestJSON-658573965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7869577-dc27-4f2f-8565-56a659636324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-969501d9-d7e5-4716-b183-987153939744 tempest-VolumesServicesTestJSON-658573965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7869577-dc27-4f2f-8565-56a659636324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-969501d9-d7e5-4716-b183-987153939744 tempest-VolumesServicesTestJSON-658573965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45a463ed-a9b9-4210-b0c7-0842b834a6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-969501d9-d7e5-4716-b183-987153939744 tempest-VolumesServicesTestJSON-658573965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45a463ed-a9b9-4210-b0c7-0842b834a6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa4daab9-5ce4-4c6d-b6d9-483e84727ffe', 'volume_name': 'volume-aa4daab9-5ce4-4c6d-b6d9-483e84727ffe', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-969501d9-d7e5-4716-b183-987153939744 tempest-VolumesServicesTestJSON-658573965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f5cf5d-e0cf-4260-86ad-88d4401262b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-969501d9-d7e5-4716-b183-987153939744 tempest-VolumesServicesTestJSON-658573965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f5cf5d-e0cf-4260-86ad-88d4401262b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-969501d9-d7e5-4716-b183-987153939744 tempest-VolumesServicesTestJSON-658573965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c643619-b464-430e-a0d8-18d52030b638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:36 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-969501d9-d7e5-4716-b183-987153939744 tempest-VolumesServicesTestJSON-658573965 None] Volume aa4daab9-5ce4-4c6d-b6d9-483e84727ffe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa4daab9-5ce4-4c6d-b6d9-483e84727ffe', 'volume_size': 1}
Apr 02 10:28:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-969501d9-d7e5-4716-b183-987153939744 tempest-VolumesServicesTestJSON-658573965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:36 devstack sudo[86536]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-92bcd625-9f0d-4d2d-a792-2a168b60c84e tempest-VolumesTransfersV357Test-1237892236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-ec59c21a-14ba-4038-bfe4-60a18e1f64bc 1073741824" returned: 0 in 0.591s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-92bcd625-9f0d-4d2d-a792-2a168b60c84e tempest-VolumesTransfersV357Test-1237892236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-ec59c21a-14ba-4038-bfe4-60a18e1f64bc {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:36 devstack sudo[86541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-ec59c21a-14ba-4038-bfe4-60a18e1f64bc
Apr 02 10:28:36 devstack sudo[86541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:36 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-813445e7-d80b-4de8-aa00-f82d1306b5d5 tempest-GroupSnapshotsTest-773077248 None] GroupSnapshot 1a2b7568-b0b4-45bc-b222-223451e1e470: creating.
Apr 02 10:28:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-813445e7-d80b-4de8-aa00-f82d1306b5d5 tempest-GroupSnapshotsTest-773077248 None] Group snapshot 1a2b7568-b0b4-45bc-b222-223451e1e470: creating. {{(pid=82102) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 02 10:28:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-813445e7-d80b-4de8-aa00-f82d1306b5d5 tempest-GroupSnapshotsTest-773077248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:37 devstack sudo[86541]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-92bcd625-9f0d-4d2d-a792-2a168b60c84e tempest-VolumesTransfersV357Test-1237892236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-ec59c21a-14ba-4038-bfe4-60a18e1f64bc" returned: 0 in 0.442s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:37 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-92bcd625-9f0d-4d2d-a792-2a168b60c84e tempest-VolumesTransfersV357Test-1237892236 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:28:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-92bcd625-9f0d-4d2d-a792-2a168b60c84e tempest-VolumesTransfersV357Test-1237892236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-969501d9-d7e5-4716-b183-987153939744 tempest-VolumesServicesTestJSON-658573965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.772s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:37 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-969501d9-d7e5-4716-b183-987153939744 tempest-VolumesServicesTestJSON-658573965 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-751453370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa4daab9-5ce4-4c6d-b6d9-483e84727ffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d7e4f6600548ff87a478656ebb9c73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:28:36Z,use_quota=True,user_id='27923e6e42f24958b9e420d1b5c88971',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:28:37 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-969501d9-d7e5-4716-b183-987153939744 tempest-VolumesServicesTestJSON-658573965 None] Creating volume aa4daab9-5ce4-4c6d-b6d9-483e84727ffe {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:28:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-969501d9-d7e5-4716-b183-987153939744 tempest-VolumesServicesTestJSON-658573965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-969501d9-d7e5-4716-b183-987153939744 tempest-VolumesServicesTestJSON-658573965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:37 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-969501d9-d7e5-4716-b183-987153939744 tempest-VolumesServicesTestJSON-658573965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:28:37 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-969501d9-d7e5-4716-b183-987153939744 tempest-VolumesServicesTestJSON-658573965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:28:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-969501d9-d7e5-4716-b183-987153939744 tempest-VolumesServicesTestJSON-658573965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:37 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-969501d9-d7e5-4716-b183-987153939744 tempest-VolumesServicesTestJSON-658573965 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:28:37 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-969501d9-d7e5-4716-b183-987153939744 tempest-VolumesServicesTestJSON-658573965 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:28:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-969501d9-d7e5-4716-b183-987153939744 tempest-VolumesServicesTestJSON-658573965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-aa4daab9-5ce4-4c6d-b6d9-483e84727ffe 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:37 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-92bcd625-9f0d-4d2d-a792-2a168b60c84e tempest-VolumesTransfersV357Test-1237892236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a439d931-c888-43dc-ac62-076a2d866504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec59c21a-14ba-4038-bfe4-60a18e1f64bc', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:37 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-92bcd625-9f0d-4d2d-a792-2a168b60c84e tempest-VolumesTransfersV357Test-1237892236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5720a0c-021b-4f08-b423-41e625dd7193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:37 devstack sudo[86544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-aa4daab9-5ce4-4c6d-b6d9-483e84727ffe 1073741824
Apr 02 10:28:37 devstack sudo[86544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:37 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-92bcd625-9f0d-4d2d-a792-2a168b60c84e tempest-VolumesTransfersV357Test-1237892236 None] Volume volume-ec59c21a-14ba-4038-bfe4-60a18e1f64bc (ec59c21a-14ba-4038-bfe4-60a18e1f64bc): created successfully
Apr 02 10:28:37 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-92bcd625-9f0d-4d2d-a792-2a168b60c84e tempest-VolumesTransfersV357Test-1237892236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5720a0c-021b-4f08-b423-41e625dd7193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:37 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-92bcd625-9f0d-4d2d-a792-2a168b60c84e tempest-VolumesTransfersV357Test-1237892236 None] Flow 'volume_create_manager' (ff280db3-d2ae-48a5-85c7-b895e5387d45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:28:37 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-92bcd625-9f0d-4d2d-a792-2a168b60c84e tempest-VolumesTransfersV357Test-1237892236 None] Created volume successfully.
Apr 02 10:28:37 devstack sudo[86544]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-969501d9-d7e5-4716-b183-987153939744 tempest-VolumesServicesTestJSON-658573965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-aa4daab9-5ce4-4c6d-b6d9-483e84727ffe 1073741824" returned: 0 in 0.583s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-969501d9-d7e5-4716-b183-987153939744 tempest-VolumesServicesTestJSON-658573965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-aa4daab9-5ce4-4c6d-b6d9-483e84727ffe {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:37 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-4474fe05-4ff3-4e26-b584-11cbe80dd8a0 tempest-VolumesTransfersV357Test-1637088910 None] Acquiring lock "cinder-ec59c21a-14ba-4038-bfe4-60a18e1f64bc-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:37 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-4474fe05-4ff3-4e26-b584-11cbe80dd8a0 tempest-VolumesTransfersV357Test-1637088910 None] Lock "cinder-ec59c21a-14ba-4038-bfe4-60a18e1f64bc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:37 devstack sudo[86549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-aa4daab9-5ce4-4c6d-b6d9-483e84727ffe
Apr 02 10:28:37 devstack sudo[86549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:37 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-4474fe05-4ff3-4e26-b584-11cbe80dd8a0 tempest-VolumesTransfersV357Test-1637088910 None] Acquiring lock "cinder-quobyte-ec59c21a-14ba-4038-bfe4-60a18e1f64bc" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:37 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-4474fe05-4ff3-4e26-b584-11cbe80dd8a0 tempest-VolumesTransfersV357Test-1637088910 None] Lock "cinder-quobyte-ec59c21a-14ba-4038-bfe4-60a18e1f64bc" acquired by "delete_volume" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:37 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff54514-a6eb-4a92-8b80-c122d3a73cf7]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:28:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4474fe05-4ff3-4e26-b584-11cbe80dd8a0 tempest-VolumesTransfersV357Test-1637088910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-ec59c21a-14ba-4038-bfe4-60a18e1f64bc {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:37 devstack sudo[86551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-ec59c21a-14ba-4038-bfe4-60a18e1f64bc
Apr 02 10:28:37 devstack sudo[86551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:38 devstack sudo[86549]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-969501d9-d7e5-4716-b183-987153939744 tempest-VolumesServicesTestJSON-658573965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-aa4daab9-5ce4-4c6d-b6d9-483e84727ffe" returned: 0 in 0.538s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:38 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-969501d9-d7e5-4716-b183-987153939744 tempest-VolumesServicesTestJSON-658573965 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:28:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-969501d9-d7e5-4716-b183-987153939744 tempest-VolumesServicesTestJSON-658573965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-813445e7-d80b-4de8-aa00-f82d1306b5d5 tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.280s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:38 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-969501d9-d7e5-4716-b183-987153939744 tempest-VolumesServicesTestJSON-658573965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c643619-b464-430e-a0d8-18d52030b638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa4daab9-5ce4-4c6d-b6d9-483e84727ffe', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:38 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-969501d9-d7e5-4716-b183-987153939744 tempest-VolumesServicesTestJSON-658573965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (471a9f60-d238-44c0-8d84-3f0824b1290a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:38 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-813445e7-d80b-4de8-aa00-f82d1306b5d5 tempest-GroupSnapshotsTest-773077248 None] Creating offline snapshot 052d83e9-02a7-4042-a391-684f57ee621a of volume c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:28:38 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-969501d9-d7e5-4716-b183-987153939744 tempest-VolumesServicesTestJSON-658573965 None] Volume volume-aa4daab9-5ce4-4c6d-b6d9-483e84727ffe (aa4daab9-5ce4-4c6d-b6d9-483e84727ffe): created successfully
Apr 02 10:28:38 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-969501d9-d7e5-4716-b183-987153939744 tempest-VolumesServicesTestJSON-658573965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (471a9f60-d238-44c0-8d84-3f0824b1290a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:38 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-969501d9-d7e5-4716-b183-987153939744 tempest-VolumesServicesTestJSON-658573965 None] Flow 'volume_create_manager' (6770a14a-3bd4-4eeb-84a2-5af6f9506399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:28:38 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c82ef8-d954-48fa-994c-0e1ee4344e57]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:28:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-813445e7-d80b-4de8-aa00-f82d1306b5d5 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:38 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-969501d9-d7e5-4716-b183-987153939744 tempest-VolumesServicesTestJSON-658573965 None] Created volume successfully.
Apr 02 10:28:38 devstack sudo[86554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b
Apr 02 10:28:38 devstack sudo[86554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:38 devstack sudo[86551]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4474fe05-4ff3-4e26-b584-11cbe80dd8a0 tempest-VolumesTransfersV357Test-1637088910 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-ec59c21a-14ba-4038-bfe4-60a18e1f64bc" returned: 0 in 0.620s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4474fe05-4ff3-4e26-b584-11cbe80dd8a0 tempest-VolumesTransfersV357Test-1637088910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-ec59c21a-14ba-4038-bfe4-60a18e1f64bc {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:38 devstack sudo[86559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-ec59c21a-14ba-4038-bfe4-60a18e1f64bc
Apr 02 10:28:38 devstack sudo[86559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:38 devstack sudo[86554]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-813445e7-d80b-4de8-aa00-f82d1306b5d5 tempest-GroupSnapshotsTest-773077248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b" returned: 0 in 0.557s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-813445e7-d80b-4de8-aa00-f82d1306b5d5 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b.052d83e9-02a7-4042-a391-684f57ee621a 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:38 devstack sudo[86565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b.052d83e9-02a7-4042-a391-684f57ee621a 1G
Apr 02 10:28:38 devstack sudo[86565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:38 devstack sudo[86559]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4474fe05-4ff3-4e26-b584-11cbe80dd8a0 tempest-VolumesTransfersV357Test-1637088910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-ec59c21a-14ba-4038-bfe4-60a18e1f64bc" returned: 0 in 0.482s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:38 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-4474fe05-4ff3-4e26-b584-11cbe80dd8a0 tempest-VolumesTransfersV357Test-1637088910 None] Lock "cinder-quobyte-ec59c21a-14ba-4038-bfe4-60a18e1f64bc" released by "delete_volume" :: held 1.127s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:38 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-4474fe05-4ff3-4e26-b584-11cbe80dd8a0 tempest-VolumesTransfersV357Test-1637088910 None] Created reservations ['356c72b8-a2ba-41ac-90f1-603873ea89f0', '6dbed682-a32d-478c-b3a0-ab7f65ef5b83', '168cf035-ca3b-43e6-ad07-24586c37f6a8', '0365b721-e4de-4067-bac1-6dd042461966'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:28:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-4474fe05-4ff3-4e26-b584-11cbe80dd8a0 tempest-VolumesTransfersV357Test-1637088910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-4474fe05-4ff3-4e26-b584-11cbe80dd8a0 tempest-VolumesTransfersV357Test-1637088910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:38 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-4474fe05-4ff3-4e26-b584-11cbe80dd8a0 tempest-VolumesTransfersV357Test-1637088910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:28:38 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-4474fe05-4ff3-4e26-b584-11cbe80dd8a0 tempest-VolumesTransfersV357Test-1637088910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:28:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-4474fe05-4ff3-4e26-b584-11cbe80dd8a0 tempest-VolumesTransfersV357Test-1637088910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4474fe05-4ff3-4e26-b584-11cbe80dd8a0 tempest-VolumesTransfersV357Test-1637088910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:38 devstack sudo[86567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:28:38 devstack sudo[86567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:39 devstack sudo[86565]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-813445e7-d80b-4de8-aa00-f82d1306b5d5 tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b.052d83e9-02a7-4042-a391-684f57ee621a 1G" returned: 0 in 0.625s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-813445e7-d80b-4de8-aa00-f82d1306b5d5 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b.052d83e9-02a7-4042-a391-684f57ee621a {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:39 devstack sudo[86567]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4474fe05-4ff3-4e26-b584-11cbe80dd8a0 tempest-VolumesTransfersV357Test-1637088910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.492s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:39 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-4474fe05-4ff3-4e26-b584-11cbe80dd8a0 tempest-VolumesTransfersV357Test-1637088910 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:28:39 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-4474fe05-4ff3-4e26-b584-11cbe80dd8a0 tempest-VolumesTransfersV357Test-1637088910 None] Deleted volume successfully.
Apr 02 10:28:39 devstack sudo[86573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b.052d83e9-02a7-4042-a391-684f57ee621a
Apr 02 10:28:39 devstack sudo[86573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:39 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-db64b4bb-b1e1-4087-9902-afd17c4771c8 tempest-VolumesServicesTestJSON-658573965 None] Acquiring lock "cinder-aa4daab9-5ce4-4c6d-b6d9-483e84727ffe-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:39 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-4474fe05-4ff3-4e26-b584-11cbe80dd8a0 tempest-VolumesTransfersV357Test-1637088910 None] Lock "cinder-ec59c21a-14ba-4038-bfe4-60a18e1f64bc-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:39 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-db64b4bb-b1e1-4087-9902-afd17c4771c8 tempest-VolumesServicesTestJSON-658573965 None] Lock "cinder-aa4daab9-5ce4-4c6d-b6d9-483e84727ffe-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:39 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-db64b4bb-b1e1-4087-9902-afd17c4771c8 tempest-VolumesServicesTestJSON-658573965 None] Acquiring lock "cinder-quobyte-aa4daab9-5ce4-4c6d-b6d9-483e84727ffe" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:39 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-db64b4bb-b1e1-4087-9902-afd17c4771c8 tempest-VolumesServicesTestJSON-658573965 None] Lock "cinder-quobyte-aa4daab9-5ce4-4c6d-b6d9-483e84727ffe" acquired by "delete_volume" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:39 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0517d3d-31c8-45fd-9734-d671bd1ce384]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:28:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-db64b4bb-b1e1-4087-9902-afd17c4771c8 tempest-VolumesServicesTestJSON-658573965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-aa4daab9-5ce4-4c6d-b6d9-483e84727ffe {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:39 devstack sudo[86575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-aa4daab9-5ce4-4c6d-b6d9-483e84727ffe
Apr 02 10:28:39 devstack sudo[86575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:40 devstack sudo[86573]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-813445e7-d80b-4de8-aa00-f82d1306b5d5 tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b.052d83e9-02a7-4042-a391-684f57ee621a" returned: 0 in 0.591s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:40 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-813445e7-d80b-4de8-aa00-f82d1306b5d5 tempest-GroupSnapshotsTest-773077248 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b.052d83e9-02a7-4042-a391-684f57ee621a is being set with open permissions: ugo+rw: NotImplementedError
Apr 02 10:28:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-813445e7-d80b-4de8-aa00-f82d1306b5d5 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b.052d83e9-02a7-4042-a391-684f57ee621a {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:40 devstack sudo[86582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b.052d83e9-02a7-4042-a391-684f57ee621a
Apr 02 10:28:40 devstack sudo[86582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:40 devstack sudo[86575]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-db64b4bb-b1e1-4087-9902-afd17c4771c8 tempest-VolumesServicesTestJSON-658573965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-aa4daab9-5ce4-4c6d-b6d9-483e84727ffe" returned: 0 in 0.614s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-db64b4bb-b1e1-4087-9902-afd17c4771c8 tempest-VolumesServicesTestJSON-658573965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-aa4daab9-5ce4-4c6d-b6d9-483e84727ffe {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:40 devstack sudo[86585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-aa4daab9-5ce4-4c6d-b6d9-483e84727ffe
Apr 02 10:28:40 devstack sudo[86585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:40 devstack sudo[86582]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-813445e7-d80b-4de8-aa00-f82d1306b5d5 tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b.052d83e9-02a7-4042-a391-684f57ee621a" returned: 0 in 0.568s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-813445e7-d80b-4de8-aa00-f82d1306b5d5 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:40 devstack sudo[86589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b.info
Apr 02 10:28:40 devstack sudo[86589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:40 devstack sudo[86585]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-db64b4bb-b1e1-4087-9902-afd17c4771c8 tempest-VolumesServicesTestJSON-658573965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-aa4daab9-5ce4-4c6d-b6d9-483e84727ffe" returned: 0 in 0.555s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:40 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-db64b4bb-b1e1-4087-9902-afd17c4771c8 tempest-VolumesServicesTestJSON-658573965 None] Lock "cinder-quobyte-aa4daab9-5ce4-4c6d-b6d9-483e84727ffe" released by "delete_volume" :: held 1.192s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:40 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-db64b4bb-b1e1-4087-9902-afd17c4771c8 tempest-VolumesServicesTestJSON-658573965 None] Created reservations ['655dfd38-412c-42e4-8b18-72b1e93996a8', 'b6b0bb58-a562-4be9-b31e-93a55b4faaae', '1bb7113d-d665-4eff-a15f-e313c5a92c63', '682aeb2e-1d6f-45c0-ad0a-46a432453d12'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:28:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-db64b4bb-b1e1-4087-9902-afd17c4771c8 tempest-VolumesServicesTestJSON-658573965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-db64b4bb-b1e1-4087-9902-afd17c4771c8 tempest-VolumesServicesTestJSON-658573965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:40 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-db64b4bb-b1e1-4087-9902-afd17c4771c8 tempest-VolumesServicesTestJSON-658573965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:28:40 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-db64b4bb-b1e1-4087-9902-afd17c4771c8 tempest-VolumesServicesTestJSON-658573965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:28:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-db64b4bb-b1e1-4087-9902-afd17c4771c8 tempest-VolumesServicesTestJSON-658573965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-db64b4bb-b1e1-4087-9902-afd17c4771c8 tempest-VolumesServicesTestJSON-658573965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:40 devstack sudo[86597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:28:40 devstack sudo[86597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:41 devstack sudo[86589]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-813445e7-d80b-4de8-aa00-f82d1306b5d5 tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b.info" returned: 0 in 0.622s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:41 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-813445e7-d80b-4de8-aa00-f82d1306b5d5 tempest-GroupSnapshotsTest-773077248 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 02 10:28:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-813445e7-d80b-4de8-aa00-f82d1306b5d5 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:41 devstack sudo[86601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b.info
Apr 02 10:28:41 devstack sudo[86601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:41 devstack sudo[86597]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-db64b4bb-b1e1-4087-9902-afd17c4771c8 tempest-VolumesServicesTestJSON-658573965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.599s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:41 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-db64b4bb-b1e1-4087-9902-afd17c4771c8 tempest-VolumesServicesTestJSON-658573965 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:28:41 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-db64b4bb-b1e1-4087-9902-afd17c4771c8 tempest-VolumesServicesTestJSON-658573965 None] Deleted volume successfully.
Apr 02 10:28:41 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-db64b4bb-b1e1-4087-9902-afd17c4771c8 tempest-VolumesServicesTestJSON-658573965 None] Lock "cinder-aa4daab9-5ce4-4c6d-b6d9-483e84727ffe-delete_volume" released by "delete_volume" :: held 1.945s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:41 devstack sudo[86601]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-813445e7-d80b-4de8-aa00-f82d1306b5d5 tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b.info" returned: 0 in 0.519s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-813445e7-d80b-4de8-aa00-f82d1306b5d5 tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.578s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:41 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-813445e7-d80b-4de8-aa00-f82d1306b5d5 tempest-GroupSnapshotsTest-773077248 None] group_snapshot 1a2b7568-b0b4-45bc-b222-223451e1e470: created successfully
Apr 02 10:28:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:43 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] Acquiring lock "cinder-quobyte-052d83e9-02a7-4042-a391-684f57ee621a-290f1263-fa5d-474e-9ed4-b6dda1ffabdc" by "_create_volume_from_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:43 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] Lock "cinder-quobyte-052d83e9-02a7-4042-a391-684f57ee621a-290f1263-fa5d-474e-9ed4-b6dda1ffabdc" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:43 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] Creating volume 290f1263-fa5d-474e-9ed4-b6dda1ffabdc from snapshot 052d83e9-02a7-4042-a391-684f57ee621a {{(pid=82102) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 02 10:28:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:43 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:28:43 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:28:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:43 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:28:43 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] Acquiring lock "cinder-quobyte-290f1263-fa5d-474e-9ed4-b6dda1ffabdc" by "_copy_volume_from_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:43 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] Lock "cinder-quobyte-290f1263-fa5d-474e-9ed4-b6dda1ffabdc" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:43 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] snapshot: 052d83e9-02a7-4042-a391-684f57ee621a, volume: 290f1263-fa5d-474e-9ed4-b6dda1ffabdc,  {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 02 10:28:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:43 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:28:43 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:28:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:43 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a790cb-5307-4615-9e53-a9e2ec581f27]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:28:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b.052d83e9-02a7-4042-a391-684f57ee621a {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:43 devstack sudo[86605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b.052d83e9-02a7-4042-a391-684f57ee621a
Apr 02 10:28:43 devstack sudo[86605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:43 devstack sudo[86605]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b.052d83e9-02a7-4042-a391-684f57ee621a" returned: 0 in 0.552s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:43 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:28:43 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 02 10:28:43 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] Creating direct copy from snapshot {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 02 10:28:43 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb94bec-2061-4e68-9fe1-8b4644cef884]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:28:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:43 devstack sudo[86610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b
Apr 02 10:28:43 devstack sudo[86610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:44 devstack sudo[86610]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:44 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b" returned: 0 in 0.655s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:44 devstack cinder-volume[82102]: DEBUG cinder.utils [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] Path /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-290f1263-fa5d-474e-9ed4-b6dda1ffabdc not found in is_blk_device check {{(pid=82102) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 02 10:28:44 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-290f1263-fa5d-474e-9ed4-b6dda1ffabdc {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:44 devstack sudo[86615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-290f1263-fa5d-474e-9ed4-b6dda1ffabdc
Apr 02 10:28:44 devstack sudo[86615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:47 devstack sudo[86615]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-290f1263-fa5d-474e-9ed4-b6dda1ffabdc" returned: 0 in 2.653s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:47 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e16f73-480b-420c-8519-4d5225a75d01]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:28:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:47 devstack sudo[86659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b
Apr 02 10:28:47 devstack sudo[86659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:47 devstack sudo[86659]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b" returned: 0 in 0.771s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:47 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] Image conversion details: src /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b, size 1024.00 MB, duration 2.65 sec, destination /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-290f1263-fa5d-474e-9ed4-b6dda1ffabdc {{(pid=82102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 02 10:28:47 devstack cinder-volume[82102]: INFO cinder.image.image_utils [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] Converted 1024.00 MB image at 385.75 MB/s
Apr 02 10:28:47 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-290f1263-fa5d-474e-9ed4-b6dda1ffabdc is being set with open permissions: ugo+rw: NotImplementedError
Apr 02 10:28:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-290f1263-fa5d-474e-9ed4-b6dda1ffabdc {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:47 devstack sudo[86666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-290f1263-fa5d-474e-9ed4-b6dda1ffabdc
Apr 02 10:28:47 devstack sudo[86666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:48 devstack sudo[86666]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-290f1263-fa5d-474e-9ed4-b6dda1ffabdc" returned: 0 in 0.605s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:48 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] Lock "cinder-quobyte-290f1263-fa5d-474e-9ed4-b6dda1ffabdc" released by "_copy_volume_from_snapshot" :: held 5.308s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:48 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] Lock "cinder-quobyte-052d83e9-02a7-4042-a391-684f57ee621a-290f1263-fa5d-474e-9ed4-b6dda1ffabdc" released by "_create_volume_from_snapshot" :: held 5.329s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.347s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:48 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-ab939688-a66f-497c-a06a-dd7173422d66 tempest-GroupSnapshotsTest-773077248 None] Create group from source-snapshot-1a2b7568-b0b4-45bc-b222-223451e1e470 completed successfully.
Apr 02 10:28:48 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0f2a0e5-1afc-40d3-87eb-6a5bb2413ca6 tempest-VolumesNegativeTest-723577322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:28:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d0f2a0e5-1afc-40d3-87eb-6a5bb2413ca6 tempest-VolumesNegativeTest-723577322 None] Flow 'volume_create_manager' (bfdf6e4c-a7c3-4414-8982-a07786524841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:28:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d0f2a0e5-1afc-40d3-87eb-6a5bb2413ca6 tempest-VolumesNegativeTest-723577322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0848cc8-966b-4dbc-b6e4-4f2e07d58597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d0f2a0e5-1afc-40d3-87eb-6a5bb2413ca6 tempest-VolumesNegativeTest-723577322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0848cc8-966b-4dbc-b6e4-4f2e07d58597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1980058019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33aa3aee-6015-4f0e-8811-b0a30cc80742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc85e07b4aae4659a7c80c844bc9f5a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:28:49Z,use_quota=True,user_id='a161c4222cef43b48d6d13dcced0baec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d0f2a0e5-1afc-40d3-87eb-6a5bb2413ca6 tempest-VolumesNegativeTest-723577322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (915fda22-ed4f-4065-b386-52d84ebc06a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d0f2a0e5-1afc-40d3-87eb-6a5bb2413ca6 tempest-VolumesNegativeTest-723577322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (915fda22-ed4f-4065-b386-52d84ebc06a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d0f2a0e5-1afc-40d3-87eb-6a5bb2413ca6 tempest-VolumesNegativeTest-723577322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a50c6a2a-3b86-47f0-b091-4e02815a757f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d0f2a0e5-1afc-40d3-87eb-6a5bb2413ca6 tempest-VolumesNegativeTest-723577322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a50c6a2a-3b86-47f0-b091-4e02815a757f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33aa3aee-6015-4f0e-8811-b0a30cc80742', 'volume_name': 'volume-33aa3aee-6015-4f0e-8811-b0a30cc80742', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:49 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d0f2a0e5-1afc-40d3-87eb-6a5bb2413ca6 tempest-VolumesNegativeTest-723577322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6919295-4586-47ad-b5f7-1154d050a312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:49 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d0f2a0e5-1afc-40d3-87eb-6a5bb2413ca6 tempest-VolumesNegativeTest-723577322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6919295-4586-47ad-b5f7-1154d050a312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:49 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d0f2a0e5-1afc-40d3-87eb-6a5bb2413ca6 tempest-VolumesNegativeTest-723577322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df226bdb-d859-4ac0-9b28-5a6cf55a23b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:49 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-d0f2a0e5-1afc-40d3-87eb-6a5bb2413ca6 tempest-VolumesNegativeTest-723577322 None] Volume 33aa3aee-6015-4f0e-8811-b0a30cc80742: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33aa3aee-6015-4f0e-8811-b0a30cc80742', 'volume_size': 1}
Apr 02 10:28:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d0f2a0e5-1afc-40d3-87eb-6a5bb2413ca6 tempest-VolumesNegativeTest-723577322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d0f2a0e5-1afc-40d3-87eb-6a5bb2413ca6 tempest-VolumesNegativeTest-723577322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:49 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d0f2a0e5-1afc-40d3-87eb-6a5bb2413ca6 tempest-VolumesNegativeTest-723577322 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1980058019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33aa3aee-6015-4f0e-8811-b0a30cc80742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc85e07b4aae4659a7c80c844bc9f5a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:28:49Z,use_quota=True,user_id='a161c4222cef43b48d6d13dcced0baec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:28:49 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-d0f2a0e5-1afc-40d3-87eb-6a5bb2413ca6 tempest-VolumesNegativeTest-723577322 None] Creating volume 33aa3aee-6015-4f0e-8811-b0a30cc80742 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:28:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d0f2a0e5-1afc-40d3-87eb-6a5bb2413ca6 tempest-VolumesNegativeTest-723577322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d0f2a0e5-1afc-40d3-87eb-6a5bb2413ca6 tempest-VolumesNegativeTest-723577322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:49 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d0f2a0e5-1afc-40d3-87eb-6a5bb2413ca6 tempest-VolumesNegativeTest-723577322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:28:49 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d0f2a0e5-1afc-40d3-87eb-6a5bb2413ca6 tempest-VolumesNegativeTest-723577322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:28:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d0f2a0e5-1afc-40d3-87eb-6a5bb2413ca6 tempest-VolumesNegativeTest-723577322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:49 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d0f2a0e5-1afc-40d3-87eb-6a5bb2413ca6 tempest-VolumesNegativeTest-723577322 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:28:49 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-d0f2a0e5-1afc-40d3-87eb-6a5bb2413ca6 tempest-VolumesNegativeTest-723577322 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:28:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d0f2a0e5-1afc-40d3-87eb-6a5bb2413ca6 tempest-VolumesNegativeTest-723577322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33aa3aee-6015-4f0e-8811-b0a30cc80742 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:49 devstack sudo[86669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33aa3aee-6015-4f0e-8811-b0a30cc80742 1073741824
Apr 02 10:28:49 devstack sudo[86669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:49 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-76805782-ad2c-4d9b-8a5d-2135e52c7ba2 tempest-GroupSnapshotsTest-773077248 None] Acquiring lock "cinder-quobyte-290f1263-fa5d-474e-9ed4-b6dda1ffabdc" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:49 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-76805782-ad2c-4d9b-8a5d-2135e52c7ba2 tempest-GroupSnapshotsTest-773077248 None] Lock "cinder-quobyte-290f1263-fa5d-474e-9ed4-b6dda1ffabdc" acquired by "delete_volume" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:49 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[901dc969-fb59-472a-86c9-b203dd046c2f]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:28:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-76805782-ad2c-4d9b-8a5d-2135e52c7ba2 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-290f1263-fa5d-474e-9ed4-b6dda1ffabdc {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:49 devstack sudo[86671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-290f1263-fa5d-474e-9ed4-b6dda1ffabdc
Apr 02 10:28:49 devstack sudo[86671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:49 devstack sudo[86669]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d0f2a0e5-1afc-40d3-87eb-6a5bb2413ca6 tempest-VolumesNegativeTest-723577322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33aa3aee-6015-4f0e-8811-b0a30cc80742 1073741824" returned: 0 in 0.665s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d0f2a0e5-1afc-40d3-87eb-6a5bb2413ca6 tempest-VolumesNegativeTest-723577322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33aa3aee-6015-4f0e-8811-b0a30cc80742 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:49 devstack sudo[86676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33aa3aee-6015-4f0e-8811-b0a30cc80742
Apr 02 10:28:49 devstack sudo[86676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:49 devstack sudo[86671]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-76805782-ad2c-4d9b-8a5d-2135e52c7ba2 tempest-GroupSnapshotsTest-773077248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-290f1263-fa5d-474e-9ed4-b6dda1ffabdc" returned: 0 in 0.598s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-76805782-ad2c-4d9b-8a5d-2135e52c7ba2 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-290f1263-fa5d-474e-9ed4-b6dda1ffabdc {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:49 devstack sudo[86681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-290f1263-fa5d-474e-9ed4-b6dda1ffabdc
Apr 02 10:28:49 devstack sudo[86681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:50 devstack sudo[86676]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d0f2a0e5-1afc-40d3-87eb-6a5bb2413ca6 tempest-VolumesNegativeTest-723577322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33aa3aee-6015-4f0e-8811-b0a30cc80742" returned: 0 in 0.509s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d0f2a0e5-1afc-40d3-87eb-6a5bb2413ca6 tempest-VolumesNegativeTest-723577322 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d0f2a0e5-1afc-40d3-87eb-6a5bb2413ca6 tempest-VolumesNegativeTest-723577322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d0f2a0e5-1afc-40d3-87eb-6a5bb2413ca6 tempest-VolumesNegativeTest-723577322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df226bdb-d859-4ac0-9b28-5a6cf55a23b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33aa3aee-6015-4f0e-8811-b0a30cc80742', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d0f2a0e5-1afc-40d3-87eb-6a5bb2413ca6 tempest-VolumesNegativeTest-723577322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0e6b552-a236-4a9b-bde0-a397a7483092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:50 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-d0f2a0e5-1afc-40d3-87eb-6a5bb2413ca6 tempest-VolumesNegativeTest-723577322 None] Volume volume-33aa3aee-6015-4f0e-8811-b0a30cc80742 (33aa3aee-6015-4f0e-8811-b0a30cc80742): created successfully
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d0f2a0e5-1afc-40d3-87eb-6a5bb2413ca6 tempest-VolumesNegativeTest-723577322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0e6b552-a236-4a9b-bde0-a397a7483092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d0f2a0e5-1afc-40d3-87eb-6a5bb2413ca6 tempest-VolumesNegativeTest-723577322 None] Flow 'volume_create_manager' (bfdf6e4c-a7c3-4414-8982-a07786524841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:28:50 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-d0f2a0e5-1afc-40d3-87eb-6a5bb2413ca6 tempest-VolumesNegativeTest-723577322 None] Created volume successfully.
Apr 02 10:28:50 devstack sudo[86681]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-76805782-ad2c-4d9b-8a5d-2135e52c7ba2 tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-290f1263-fa5d-474e-9ed4-b6dda1ffabdc" returned: 0 in 0.506s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-76805782-ad2c-4d9b-8a5d-2135e52c7ba2 tempest-GroupSnapshotsTest-773077248 None] Lock "cinder-quobyte-290f1263-fa5d-474e-9ed4-b6dda1ffabdc" released by "delete_volume" :: held 1.143s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-98c0a175-507e-4c52-bd45-0a7db35953e7 tempest-VolumeTypesAccessTest-462639360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-98c0a175-507e-4c52-bd45-0a7db35953e7 tempest-VolumeTypesAccessTest-462639360 None] Flow 'volume_create_manager' (61af61b4-35c3-4b73-a32f-52ff29001e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-98c0a175-507e-4c52-bd45-0a7db35953e7 tempest-VolumeTypesAccessTest-462639360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53c8a69e-7519-4076-8226-ed1027a82586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-98c0a175-507e-4c52-bd45-0a7db35953e7 tempest-VolumeTypesAccessTest-462639360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53c8a69e-7519-4076-8226-ed1027a82586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2142536867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2caac7b8-6061-4235-a202-827efdfe7ac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='745ab8bb482745a2b9b97a92a30f699f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:28:50Z,use_quota=True,user_id='f07ff5ad21324263ae2373825920138f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dab4451-1e89-400f-862b-904fcb214d5f),volume_type_id=9dab4451-1e89-400f-862b-904fcb214d5f)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-98c0a175-507e-4c52-bd45-0a7db35953e7 tempest-VolumeTypesAccessTest-462639360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b85aa7a4-5e13-427e-875d-c53f0566760e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-98c0a175-507e-4c52-bd45-0a7db35953e7 tempest-VolumeTypesAccessTest-462639360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b85aa7a4-5e13-427e-875d-c53f0566760e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-98c0a175-507e-4c52-bd45-0a7db35953e7 tempest-VolumeTypesAccessTest-462639360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa4b4ad7-171c-440e-abb8-dccd4e644942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-98c0a175-507e-4c52-bd45-0a7db35953e7 tempest-VolumeTypesAccessTest-462639360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa4b4ad7-171c-440e-abb8-dccd4e644942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2caac7b8-6061-4235-a202-827efdfe7ac2', 'volume_name': 'volume-2caac7b8-6061-4235-a202-827efdfe7ac2', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-98c0a175-507e-4c52-bd45-0a7db35953e7 tempest-VolumeTypesAccessTest-462639360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebbe5584-2991-4fd5-acfa-c54b94152d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-98c0a175-507e-4c52-bd45-0a7db35953e7 tempest-VolumeTypesAccessTest-462639360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebbe5584-2991-4fd5-acfa-c54b94152d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-98c0a175-507e-4c52-bd45-0a7db35953e7 tempest-VolumeTypesAccessTest-462639360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf4be21-1a8d-4d96-b79b-5d19f0364b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:50 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-98c0a175-507e-4c52-bd45-0a7db35953e7 tempest-VolumeTypesAccessTest-462639360 None] Volume 2caac7b8-6061-4235-a202-827efdfe7ac2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2caac7b8-6061-4235-a202-827efdfe7ac2', 'volume_size': 1}
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-98c0a175-507e-4c52-bd45-0a7db35953e7 tempest-VolumeTypesAccessTest-462639360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-98c0a175-507e-4c52-bd45-0a7db35953e7 tempest-VolumeTypesAccessTest-462639360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-98c0a175-507e-4c52-bd45-0a7db35953e7 tempest-VolumeTypesAccessTest-462639360 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2142536867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2caac7b8-6061-4235-a202-827efdfe7ac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='745ab8bb482745a2b9b97a92a30f699f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:28:50Z,use_quota=True,user_id='f07ff5ad21324263ae2373825920138f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dab4451-1e89-400f-862b-904fcb214d5f),volume_type_id=9dab4451-1e89-400f-862b-904fcb214d5f)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-98c0a175-507e-4c52-bd45-0a7db35953e7 tempest-VolumeTypesAccessTest-462639360 None] Creating volume 2caac7b8-6061-4235-a202-827efdfe7ac2 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-98c0a175-507e-4c52-bd45-0a7db35953e7 tempest-VolumeTypesAccessTest-462639360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-98c0a175-507e-4c52-bd45-0a7db35953e7 tempest-VolumeTypesAccessTest-462639360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-98c0a175-507e-4c52-bd45-0a7db35953e7 tempest-VolumeTypesAccessTest-462639360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-98c0a175-507e-4c52-bd45-0a7db35953e7 tempest-VolumeTypesAccessTest-462639360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-98c0a175-507e-4c52-bd45-0a7db35953e7 tempest-VolumeTypesAccessTest-462639360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-98c0a175-507e-4c52-bd45-0a7db35953e7 tempest-VolumeTypesAccessTest-462639360 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:28:50 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-98c0a175-507e-4c52-bd45-0a7db35953e7 tempest-VolumeTypesAccessTest-462639360 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-98c0a175-507e-4c52-bd45-0a7db35953e7 tempest-VolumeTypesAccessTest-462639360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2caac7b8-6061-4235-a202-827efdfe7ac2 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:50 devstack sudo[86685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2caac7b8-6061-4235-a202-827efdfe7ac2 1073741824
Apr 02 10:28:50 devstack sudo[86685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-76805782-ad2c-4d9b-8a5d-2135e52c7ba2 tempest-GroupSnapshotsTest-773077248 None] Created reservations ['1f82f6a9-5ad9-4f64-b9f8-eb1acbb4c738'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:28:50 devstack cinder-volume[82102]: WARNING cinder.quota [None req-76805782-ad2c-4d9b-8a5d-2135e52c7ba2 tempest-GroupSnapshotsTest-773077248 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1019589145 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1019589145, it is now deprecated. Please use the default quota class for default quota.
Apr 02 10:28:50 devstack cinder-volume[82102]: WARNING cinder.quota [None req-76805782-ad2c-4d9b-8a5d-2135e52c7ba2 tempest-GroupSnapshotsTest-773077248 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1019589145 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1019589145, it is now deprecated. Please use the default quota class for default quota.
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-76805782-ad2c-4d9b-8a5d-2135e52c7ba2 tempest-GroupSnapshotsTest-773077248 None] Created reservations ['0255c696-7573-40e2-ba8e-73664cbd5440', 'd6d3bf6d-1b78-4873-b165-751480fd6f44', 'cb46142b-e357-4ac9-8217-c195f4a3d5bd', '11adfad4-cbee-4201-8243-e5ef333fe0db'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-76805782-ad2c-4d9b-8a5d-2135e52c7ba2 tempest-GroupSnapshotsTest-773077248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-76805782-ad2c-4d9b-8a5d-2135e52c7ba2 tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-76805782-ad2c-4d9b-8a5d-2135e52c7ba2 tempest-GroupSnapshotsTest-773077248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-76805782-ad2c-4d9b-8a5d-2135e52c7ba2 tempest-GroupSnapshotsTest-773077248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-76805782-ad2c-4d9b-8a5d-2135e52c7ba2 tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-76805782-ad2c-4d9b-8a5d-2135e52c7ba2 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:50 devstack sudo[86687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:28:50 devstack sudo[86687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:51 devstack sudo[86685]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-98c0a175-507e-4c52-bd45-0a7db35953e7 tempest-VolumeTypesAccessTest-462639360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2caac7b8-6061-4235-a202-827efdfe7ac2 1073741824" returned: 0 in 0.614s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-98c0a175-507e-4c52-bd45-0a7db35953e7 tempest-VolumeTypesAccessTest-462639360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2caac7b8-6061-4235-a202-827efdfe7ac2 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:51 devstack sudo[86694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2caac7b8-6061-4235-a202-827efdfe7ac2
Apr 02 10:28:51 devstack sudo[86694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:51 devstack sudo[86687]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-76805782-ad2c-4d9b-8a5d-2135e52c7ba2 tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.521s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:51 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-76805782-ad2c-4d9b-8a5d-2135e52c7ba2 tempest-GroupSnapshotsTest-773077248 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:28:51 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-76805782-ad2c-4d9b-8a5d-2135e52c7ba2 tempest-GroupSnapshotsTest-773077248 None] Delete group completed successfully.
Apr 02 10:28:51 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-b24d93ed-9fe6-4136-a13d-30012b1eac75 tempest-GroupSnapshotsTest-773077248 None] group_snapshot 1a2b7568-b0b4-45bc-b222-223451e1e470: deleting
Apr 02 10:28:51 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b24d93ed-9fe6-4136-a13d-30012b1eac75 tempest-GroupSnapshotsTest-773077248 None] group_snapshot 1a2b7568-b0b4-45bc-b222-223451e1e470: deleting {{(pid=82102) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 02 10:28:51 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-b24d93ed-9fe6-4136-a13d-30012b1eac75 tempest-GroupSnapshotsTest-773077248 None] Acquiring lock "cinder-quobyte-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:51 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-b24d93ed-9fe6-4136-a13d-30012b1eac75 tempest-GroupSnapshotsTest-773077248 None] Lock "cinder-quobyte-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:51 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-b24d93ed-9fe6-4136-a13d-30012b1eac75 tempest-GroupSnapshotsTest-773077248 None] Acquiring lock "cinder-quobyte-052d83e9-02a7-4042-a391-684f57ee621a" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:51 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-b24d93ed-9fe6-4136-a13d-30012b1eac75 tempest-GroupSnapshotsTest-773077248 None] Lock "cinder-quobyte-052d83e9-02a7-4042-a391-684f57ee621a" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:51 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-b24d93ed-9fe6-4136-a13d-30012b1eac75 tempest-GroupSnapshotsTest-773077248 None] Deleting offline snapshot 052d83e9-02a7-4042-a391-684f57ee621a of volume c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:28:51 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-b24d93ed-9fe6-4136-a13d-30012b1eac75 tempest-GroupSnapshotsTest-773077248 None] snapshot_file for this snap is: volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b.052d83e9-02a7-4042-a391-684f57ee621a {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:28:51 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f183fe60-1b8f-42e2-a782-6fdea6b4cb38]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:28:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b24d93ed-9fe6-4136-a13d-30012b1eac75 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b.052d83e9-02a7-4042-a391-684f57ee621a {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:51 devstack sudo[86698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b.052d83e9-02a7-4042-a391-684f57ee621a
Apr 02 10:28:51 devstack sudo[86698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:51 devstack sudo[86694]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-98c0a175-507e-4c52-bd45-0a7db35953e7 tempest-VolumeTypesAccessTest-462639360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2caac7b8-6061-4235-a202-827efdfe7ac2" returned: 0 in 0.678s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:51 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-98c0a175-507e-4c52-bd45-0a7db35953e7 tempest-VolumeTypesAccessTest-462639360 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:28:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-98c0a175-507e-4c52-bd45-0a7db35953e7 tempest-VolumeTypesAccessTest-462639360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:52 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-98c0a175-507e-4c52-bd45-0a7db35953e7 tempest-VolumeTypesAccessTest-462639360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf4be21-1a8d-4d96-b79b-5d19f0364b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2caac7b8-6061-4235-a202-827efdfe7ac2', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:52 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-98c0a175-507e-4c52-bd45-0a7db35953e7 tempest-VolumeTypesAccessTest-462639360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fcb28d6-5223-43d5-b558-fed57d73344e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:52 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-98c0a175-507e-4c52-bd45-0a7db35953e7 tempest-VolumeTypesAccessTest-462639360 None] Volume volume-2caac7b8-6061-4235-a202-827efdfe7ac2 (2caac7b8-6061-4235-a202-827efdfe7ac2): created successfully
Apr 02 10:28:52 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-98c0a175-507e-4c52-bd45-0a7db35953e7 tempest-VolumeTypesAccessTest-462639360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fcb28d6-5223-43d5-b558-fed57d73344e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:52 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-98c0a175-507e-4c52-bd45-0a7db35953e7 tempest-VolumeTypesAccessTest-462639360 None] Flow 'volume_create_manager' (61af61b4-35c3-4b73-a32f-52ff29001e4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:28:52 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-98c0a175-507e-4c52-bd45-0a7db35953e7 tempest-VolumeTypesAccessTest-462639360 None] Created volume successfully.
Apr 02 10:28:52 devstack sudo[86698]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b24d93ed-9fe6-4136-a13d-30012b1eac75 tempest-GroupSnapshotsTest-773077248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b.052d83e9-02a7-4042-a391-684f57ee621a" returned: 0 in 0.614s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:52 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-b24d93ed-9fe6-4136-a13d-30012b1eac75 tempest-GroupSnapshotsTest-773077248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:28:52 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce71764-c343-4d22-9313-6fc21305e15c]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:28:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b24d93ed-9fe6-4136-a13d-30012b1eac75 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:52 devstack sudo[86704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b
Apr 02 10:28:52 devstack sudo[86704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:52 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-aa08b748-2f3c-462d-92c1-9c5abe5266ba tempest-VolumeTypesAccessTest-462639360 None] Acquiring lock "cinder-2caac7b8-6061-4235-a202-827efdfe7ac2-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:52 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-aa08b748-2f3c-462d-92c1-9c5abe5266ba tempest-VolumeTypesAccessTest-462639360 None] Lock "cinder-2caac7b8-6061-4235-a202-827efdfe7ac2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:52 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-aa08b748-2f3c-462d-92c1-9c5abe5266ba tempest-VolumeTypesAccessTest-462639360 None] Acquiring lock "cinder-quobyte-2caac7b8-6061-4235-a202-827efdfe7ac2" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:52 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-aa08b748-2f3c-462d-92c1-9c5abe5266ba tempest-VolumeTypesAccessTest-462639360 None] Lock "cinder-quobyte-2caac7b8-6061-4235-a202-827efdfe7ac2" acquired by "delete_volume" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:52 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[620f3f19-e0d5-4700-848c-cba41cc697c8]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:28:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-aa08b748-2f3c-462d-92c1-9c5abe5266ba tempest-VolumeTypesAccessTest-462639360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2caac7b8-6061-4235-a202-827efdfe7ac2 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:52 devstack sudo[86706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2caac7b8-6061-4235-a202-827efdfe7ac2
Apr 02 10:28:52 devstack sudo[86706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:52 devstack sudo[86704]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b24d93ed-9fe6-4136-a13d-30012b1eac75 tempest-GroupSnapshotsTest-773077248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b" returned: 0 in 0.657s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b24d93ed-9fe6-4136-a13d-30012b1eac75 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b.052d83e9-02a7-4042-a391-684f57ee621a {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:53 devstack sudo[86711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b.052d83e9-02a7-4042-a391-684f57ee621a
Apr 02 10:28:53 devstack sudo[86711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:53 devstack sudo[86706]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-aa08b748-2f3c-462d-92c1-9c5abe5266ba tempest-VolumeTypesAccessTest-462639360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2caac7b8-6061-4235-a202-827efdfe7ac2" returned: 0 in 0.673s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-aa08b748-2f3c-462d-92c1-9c5abe5266ba tempest-VolumeTypesAccessTest-462639360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2caac7b8-6061-4235-a202-827efdfe7ac2 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:53 devstack sudo[86716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2caac7b8-6061-4235-a202-827efdfe7ac2
Apr 02 10:28:53 devstack sudo[86716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:53 devstack sudo[86711]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b24d93ed-9fe6-4136-a13d-30012b1eac75 tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b.052d83e9-02a7-4042-a391-684f57ee621a" returned: 0 in 0.606s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b24d93ed-9fe6-4136-a13d-30012b1eac75 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b.052d83e9-02a7-4042-a391-684f57ee621a {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:53 devstack sudo[86721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b.052d83e9-02a7-4042-a391-684f57ee621a
Apr 02 10:28:53 devstack sudo[86721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:54 devstack sudo[86716]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-aa08b748-2f3c-462d-92c1-9c5abe5266ba tempest-VolumeTypesAccessTest-462639360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2caac7b8-6061-4235-a202-827efdfe7ac2" returned: 0 in 0.592s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:54 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-aa08b748-2f3c-462d-92c1-9c5abe5266ba tempest-VolumeTypesAccessTest-462639360 None] Lock "cinder-quobyte-2caac7b8-6061-4235-a202-827efdfe7ac2" released by "delete_volume" :: held 1.299s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:54 devstack cinder-volume[82102]: DEBUG dbcounter [-] [82102] Writing DB stats cinder:SELECT=165,cinder:INSERT=28,cinder:UPDATE=195,cinder:DELETE=14 {{(pid=82102) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 02 10:28:54 devstack cinder-volume[82102]: WARNING cinder.quota [None req-aa08b748-2f3c-462d-92c1-9c5abe5266ba tempest-VolumeTypesAccessTest-462639360 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-217623771 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-217623771, it is now deprecated. Please use the default quota class for default quota.
Apr 02 10:28:54 devstack cinder-volume[82102]: WARNING cinder.quota [None req-aa08b748-2f3c-462d-92c1-9c5abe5266ba tempest-VolumeTypesAccessTest-462639360 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-217623771 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-217623771, it is now deprecated. Please use the default quota class for default quota.
Apr 02 10:28:54 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-aa08b748-2f3c-462d-92c1-9c5abe5266ba tempest-VolumeTypesAccessTest-462639360 None] Created reservations ['07f12a08-9ff1-4d77-8352-eebb03d6d572', '384fc6af-832a-496e-ab5c-52896052c92d', '063af644-6952-47ab-9c79-28bf6dba1008', 'f97bf426-828e-4f8a-8919-0568555deb7b'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:28:54 devstack sudo[86721]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b24d93ed-9fe6-4136-a13d-30012b1eac75 tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b.052d83e9-02a7-4042-a391-684f57ee621a" returned: 0 in 0.525s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:54 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-b24d93ed-9fe6-4136-a13d-30012b1eac75 tempest-GroupSnapshotsTest-773077248 None] Lock "cinder-quobyte-052d83e9-02a7-4042-a391-684f57ee621a" released by "_delete_snapshot" :: held 2.473s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:54 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-b24d93ed-9fe6-4136-a13d-30012b1eac75 tempest-GroupSnapshotsTest-773077248 None] Lock "cinder-quobyte-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b" released by "delete_snapshot" :: held 2.489s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-aa08b748-2f3c-462d-92c1-9c5abe5266ba tempest-VolumeTypesAccessTest-462639360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-aa08b748-2f3c-462d-92c1-9c5abe5266ba tempest-VolumeTypesAccessTest-462639360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:54 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-aa08b748-2f3c-462d-92c1-9c5abe5266ba tempest-VolumeTypesAccessTest-462639360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:28:54 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-aa08b748-2f3c-462d-92c1-9c5abe5266ba tempest-VolumeTypesAccessTest-462639360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:28:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-aa08b748-2f3c-462d-92c1-9c5abe5266ba tempest-VolumeTypesAccessTest-462639360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-aa08b748-2f3c-462d-92c1-9c5abe5266ba tempest-VolumeTypesAccessTest-462639360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:54 devstack sudo[86725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:28:54 devstack sudo[86725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:54 devstack cinder-volume[82102]: WARNING cinder.quota [None req-b24d93ed-9fe6-4136-a13d-30012b1eac75 tempest-GroupSnapshotsTest-773077248 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1019589145 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1019589145, it is now deprecated. Please use the default quota class for default quota.
Apr 02 10:28:54 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-b24d93ed-9fe6-4136-a13d-30012b1eac75 tempest-GroupSnapshotsTest-773077248 None] Created reservations ['a22526f9-c439-489f-884a-4078a47cbfb4', 'd77f51ca-ced5-46cf-a4a1-4c3a8dfc97bd', 'c4399da2-4cdb-4d9c-b775-492f1e1364d4', '9714a17d-5cf1-4203-8a43-fcf4c87ad09f'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:28:54 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-b24d93ed-9fe6-4136-a13d-30012b1eac75 tempest-GroupSnapshotsTest-773077248 None] group_snapshot 1a2b7568-b0b4-45bc-b222-223451e1e470: deleted successfully
Apr 02 10:28:54 devstack sudo[86725]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-aa08b748-2f3c-462d-92c1-9c5abe5266ba tempest-VolumeTypesAccessTest-462639360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.472s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:54 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-aa08b748-2f3c-462d-92c1-9c5abe5266ba tempest-VolumeTypesAccessTest-462639360 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:28:54 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-aa08b748-2f3c-462d-92c1-9c5abe5266ba tempest-VolumeTypesAccessTest-462639360 None] Deleted volume successfully.
Apr 02 10:28:54 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-aa08b748-2f3c-462d-92c1-9c5abe5266ba tempest-VolumeTypesAccessTest-462639360 None] Lock "cinder-2caac7b8-6061-4235-a202-827efdfe7ac2-delete_volume" released by "delete_volume" :: held 2.005s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:55 devstack cinder-volume[82102]: DEBUG dbcounter [-] [82102] Writing DB stats cinder:SELECT=151,cinder:INSERT=62,cinder:DELETE=10,cinder:UPDATE=192 {{(pid=82102) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 02 10:28:55 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2cc5a8b4-4206-45d2-94ac-b8d43c4b0b70 tempest-GroupSnapshotsTest-773077248 None] Acquiring lock "cinder-quobyte-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:28:55 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2cc5a8b4-4206-45d2-94ac-b8d43c4b0b70 tempest-GroupSnapshotsTest-773077248 None] Lock "cinder-quobyte-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b" acquired by "delete_volume" :: waited 0.017s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:28:55 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04ae788-14d2-410b-a174-d74614aca29f]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:28:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2cc5a8b4-4206-45d2-94ac-b8d43c4b0b70 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:55 devstack sudo[86728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b
Apr 02 10:28:55 devstack sudo[86728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:55 devstack sudo[86728]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2cc5a8b4-4206-45d2-94ac-b8d43c4b0b70 tempest-GroupSnapshotsTest-773077248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b" returned: 0 in 0.666s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2cc5a8b4-4206-45d2-94ac-b8d43c4b0b70 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:55 devstack sudo[86733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b
Apr 02 10:28:55 devstack sudo[86733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:56 devstack sudo[86733]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2cc5a8b4-4206-45d2-94ac-b8d43c4b0b70 tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b" returned: 0 in 0.636s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:56 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2cc5a8b4-4206-45d2-94ac-b8d43c4b0b70 tempest-GroupSnapshotsTest-773077248 None] Lock "cinder-quobyte-c5a7fa36-2759-4f3a-b7ef-9d05e1d10d4b" released by "delete_volume" :: held 1.357s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:28:56 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-2cc5a8b4-4206-45d2-94ac-b8d43c4b0b70 tempest-GroupSnapshotsTest-773077248 None] Created reservations ['dc9a7760-9de0-43b5-828a-5722b0947f79'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:28:56 devstack cinder-volume[82102]: WARNING cinder.db.sqlalchemy.api [None req-2cc5a8b4-4206-45d2-94ac-b8d43c4b0b70 tempest-GroupSnapshotsTest-773077248 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1019589145']
Apr 02 10:28:56 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-2cc5a8b4-4206-45d2-94ac-b8d43c4b0b70 tempest-GroupSnapshotsTest-773077248 None] Created reservations ['4b5e606d-7113-4d8a-83d7-bedceb31518b', 'ef9253a5-85c4-4878-9ff7-c041c342d3b4', 'cca19e61-f7ca-4298-84f4-f13c446f2c46', '92233fd8-25b5-4c0b-9a53-ff972e66a7f9'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:28:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-2cc5a8b4-4206-45d2-94ac-b8d43c4b0b70 tempest-GroupSnapshotsTest-773077248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-2cc5a8b4-4206-45d2-94ac-b8d43c4b0b70 tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:56 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-2cc5a8b4-4206-45d2-94ac-b8d43c4b0b70 tempest-GroupSnapshotsTest-773077248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:28:56 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-2cc5a8b4-4206-45d2-94ac-b8d43c4b0b70 tempest-GroupSnapshotsTest-773077248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:28:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-2cc5a8b4-4206-45d2-94ac-b8d43c4b0b70 tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2cc5a8b4-4206-45d2-94ac-b8d43c4b0b70 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:56 devstack sudo[86736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:28:56 devstack sudo[86736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:57 devstack sudo[86736]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2cc5a8b4-4206-45d2-94ac-b8d43c4b0b70 tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.603s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:57 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-2cc5a8b4-4206-45d2-94ac-b8d43c4b0b70 tempest-GroupSnapshotsTest-773077248 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:28:57 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-2cc5a8b4-4206-45d2-94ac-b8d43c4b0b70 tempest-GroupSnapshotsTest-773077248 None] Delete group completed successfully.
Apr 02 10:28:57 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-700cfa74-3c6b-4dc4-95ce-19d64641653e tempest-GroupSnapshotsTest-773077248 None] Group tempest-GroupSnapshotsTest-Group-656331134: creating
Apr 02 10:28:57 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-700cfa74-3c6b-4dc4-95ce-19d64641653e tempest-GroupSnapshotsTest-773077248 None] Group tempest-GroupSnapshotsTest-Group-656331134: created successfully
Apr 02 10:28:57 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-700cfa74-3c6b-4dc4-95ce-19d64641653e tempest-GroupSnapshotsTest-773077248 None] Create group completed successfully.
Apr 02 10:28:59 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ead0e10-c854-4078-9fb7-2279149905a7 tempest-GroupSnapshotsTest-773077248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:28:59 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8ead0e10-c854-4078-9fb7-2279149905a7 tempest-GroupSnapshotsTest-773077248 None] Flow 'volume_create_manager' (5666d17c-fb0f-4181-9bc0-aea6d9738794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:28:59 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8ead0e10-c854-4078-9fb7-2279149905a7 tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (811f3d00-1bfd-4d25-b519-fe036bb77aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:59 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8ead0e10-c854-4078-9fb7-2279149905a7 tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (811f3d00-1bfd-4d25-b519-fe036bb77aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-464500642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=12839e1b-45a2-4adf-8da8-24f5b1376f7b,host='devstack@QuobyteHD#QuobyteHD',id=2b8c6fa7-e201-426e-a693-0d605a634a00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='715df5a8413948c3abcecf488c7f9810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:28:59Z,use_quota=True,user_id='59fae1ac304a413883534cd7e39c3820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4801251c-0700-479f-87ee-d28e99304046),volume_type_id=4801251c-0700-479f-87ee-d28e99304046)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:59 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8ead0e10-c854-4078-9fb7-2279149905a7 tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef34bd9-01dc-4d7a-b62f-e274b46c0630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:59 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8ead0e10-c854-4078-9fb7-2279149905a7 tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef34bd9-01dc-4d7a-b62f-e274b46c0630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:59 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8ead0e10-c854-4078-9fb7-2279149905a7 tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65bf1a2b-4617-4dcf-99a0-0f69dfb4f17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:59 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8ead0e10-c854-4078-9fb7-2279149905a7 tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65bf1a2b-4617-4dcf-99a0-0f69dfb4f17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b8c6fa7-e201-426e-a693-0d605a634a00', 'volume_name': 'volume-2b8c6fa7-e201-426e-a693-0d605a634a00', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:59 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8ead0e10-c854-4078-9fb7-2279149905a7 tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a55b98e-9b1a-4c79-b2bf-9012f4b82dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:59 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8ead0e10-c854-4078-9fb7-2279149905a7 tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a55b98e-9b1a-4c79-b2bf-9012f4b82dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:28:59 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8ead0e10-c854-4078-9fb7-2279149905a7 tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fef13c30-12d4-4b91-b2d4-3861c56b5b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:28:59 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-8ead0e10-c854-4078-9fb7-2279149905a7 tempest-GroupSnapshotsTest-773077248 None] Volume 2b8c6fa7-e201-426e-a693-0d605a634a00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b8c6fa7-e201-426e-a693-0d605a634a00', 'volume_size': 1}
Apr 02 10:28:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8ead0e10-c854-4078-9fb7-2279149905a7 tempest-GroupSnapshotsTest-773077248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8ead0e10-c854-4078-9fb7-2279149905a7 tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:59 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8ead0e10-c854-4078-9fb7-2279149905a7 tempest-GroupSnapshotsTest-773077248 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=12839e1b-45a2-4adf-8da8-24f5b1376f7b,created_at=2026-04-02T08:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-464500642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=12839e1b-45a2-4adf-8da8-24f5b1376f7b,host='devstack@QuobyteHD#QuobyteHD',id=2b8c6fa7-e201-426e-a693-0d605a634a00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='715df5a8413948c3abcecf488c7f9810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:28:59Z,use_quota=True,user_id='59fae1ac304a413883534cd7e39c3820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4801251c-0700-479f-87ee-d28e99304046),volume_type_id=4801251c-0700-479f-87ee-d28e99304046)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:28:59 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-8ead0e10-c854-4078-9fb7-2279149905a7 tempest-GroupSnapshotsTest-773077248 None] Creating volume 2b8c6fa7-e201-426e-a693-0d605a634a00 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:28:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8ead0e10-c854-4078-9fb7-2279149905a7 tempest-GroupSnapshotsTest-773077248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:28:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8ead0e10-c854-4078-9fb7-2279149905a7 tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:28:59 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8ead0e10-c854-4078-9fb7-2279149905a7 tempest-GroupSnapshotsTest-773077248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:28:59 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8ead0e10-c854-4078-9fb7-2279149905a7 tempest-GroupSnapshotsTest-773077248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:28:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8ead0e10-c854-4078-9fb7-2279149905a7 tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:28:59 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8ead0e10-c854-4078-9fb7-2279149905a7 tempest-GroupSnapshotsTest-773077248 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:28:59 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-8ead0e10-c854-4078-9fb7-2279149905a7 tempest-GroupSnapshotsTest-773077248 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:28:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8ead0e10-c854-4078-9fb7-2279149905a7 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:28:59 devstack sudo[86757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00 1073741824
Apr 02 10:28:59 devstack sudo[86757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:28:59 devstack sudo[86757]: pam_unix(sudo:session): session closed for user root
Apr 02 10:28:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8ead0e10-c854-4078-9fb7-2279149905a7 tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00 1073741824" returned: 0 in 0.597s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:28:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8ead0e10-c854-4078-9fb7-2279149905a7 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:00 devstack sudo[86762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00
Apr 02 10:29:00 devstack sudo[86762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:00 devstack sudo[86762]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8ead0e10-c854-4078-9fb7-2279149905a7 tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00" returned: 0 in 0.509s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:00 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8ead0e10-c854-4078-9fb7-2279149905a7 tempest-GroupSnapshotsTest-773077248 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:29:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8ead0e10-c854-4078-9fb7-2279149905a7 tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:00 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8ead0e10-c854-4078-9fb7-2279149905a7 tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fef13c30-12d4-4b91-b2d4-3861c56b5b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b8c6fa7-e201-426e-a693-0d605a634a00', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:00 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8ead0e10-c854-4078-9fb7-2279149905a7 tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3c96211-6fc3-45dd-b921-cc65cdc873c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:00 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-8ead0e10-c854-4078-9fb7-2279149905a7 tempest-GroupSnapshotsTest-773077248 None] Volume volume-2b8c6fa7-e201-426e-a693-0d605a634a00 (2b8c6fa7-e201-426e-a693-0d605a634a00): created successfully
Apr 02 10:29:00 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8ead0e10-c854-4078-9fb7-2279149905a7 tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3c96211-6fc3-45dd-b921-cc65cdc873c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:00 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8ead0e10-c854-4078-9fb7-2279149905a7 tempest-GroupSnapshotsTest-773077248 None] Flow 'volume_create_manager' (5666d17c-fb0f-4181-9bc0-aea6d9738794) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:00 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-8ead0e10-c854-4078-9fb7-2279149905a7 tempest-GroupSnapshotsTest-773077248 None] Created volume successfully.
Apr 02 10:29:01 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-e73fc5f0-97c9-41b8-93f3-b63511cf5b9d tempest-GroupSnapshotsTest-773077248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:29:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e73fc5f0-97c9-41b8-93f3-b63511cf5b9d tempest-GroupSnapshotsTest-773077248 None] Flow 'volume_create_manager' (22a0efa4-7243-4087-aca0-486d54c14327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e73fc5f0-97c9-41b8-93f3-b63511cf5b9d tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6679f1b4-ae7a-4df6-8242-5b908a66a9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e73fc5f0-97c9-41b8-93f3-b63511cf5b9d tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6679f1b4-ae7a-4df6-8242-5b908a66a9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-135266892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=12839e1b-45a2-4adf-8da8-24f5b1376f7b,host='devstack@QuobyteHD#QuobyteHD',id=f9fb7d59-a6df-4105-9826-6bfca4c2784d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='715df5a8413948c3abcecf488c7f9810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:02Z,use_quota=True,user_id='59fae1ac304a413883534cd7e39c3820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4801251c-0700-479f-87ee-d28e99304046),volume_type_id=4801251c-0700-479f-87ee-d28e99304046)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e73fc5f0-97c9-41b8-93f3-b63511cf5b9d tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7362affd-3dfb-4345-90c0-1124859f2fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e73fc5f0-97c9-41b8-93f3-b63511cf5b9d tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7362affd-3dfb-4345-90c0-1124859f2fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e73fc5f0-97c9-41b8-93f3-b63511cf5b9d tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e666095d-0f86-43bd-b354-18fe15a9907e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e73fc5f0-97c9-41b8-93f3-b63511cf5b9d tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e666095d-0f86-43bd-b354-18fe15a9907e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9fb7d59-a6df-4105-9826-6bfca4c2784d', 'volume_name': 'volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e73fc5f0-97c9-41b8-93f3-b63511cf5b9d tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (170853aa-0dff-44b7-8fd3-5c1b1ee5e39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e73fc5f0-97c9-41b8-93f3-b63511cf5b9d tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (170853aa-0dff-44b7-8fd3-5c1b1ee5e39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e73fc5f0-97c9-41b8-93f3-b63511cf5b9d tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ea88c0-b5c1-46a4-a612-7b3c4ee53a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:01 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-e73fc5f0-97c9-41b8-93f3-b63511cf5b9d tempest-GroupSnapshotsTest-773077248 None] Volume f9fb7d59-a6df-4105-9826-6bfca4c2784d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d', 'volume_size': 1}
Apr 02 10:29:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e73fc5f0-97c9-41b8-93f3-b63511cf5b9d tempest-GroupSnapshotsTest-773077248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e73fc5f0-97c9-41b8-93f3-b63511cf5b9d tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:01 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e73fc5f0-97c9-41b8-93f3-b63511cf5b9d tempest-GroupSnapshotsTest-773077248 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=12839e1b-45a2-4adf-8da8-24f5b1376f7b,created_at=2026-04-02T08:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-135266892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=12839e1b-45a2-4adf-8da8-24f5b1376f7b,host='devstack@QuobyteHD#QuobyteHD',id=f9fb7d59-a6df-4105-9826-6bfca4c2784d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='715df5a8413948c3abcecf488c7f9810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:02Z,use_quota=True,user_id='59fae1ac304a413883534cd7e39c3820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4801251c-0700-479f-87ee-d28e99304046),volume_type_id=4801251c-0700-479f-87ee-d28e99304046)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:29:01 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-e73fc5f0-97c9-41b8-93f3-b63511cf5b9d tempest-GroupSnapshotsTest-773077248 None] Creating volume f9fb7d59-a6df-4105-9826-6bfca4c2784d {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:29:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e73fc5f0-97c9-41b8-93f3-b63511cf5b9d tempest-GroupSnapshotsTest-773077248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e73fc5f0-97c9-41b8-93f3-b63511cf5b9d tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:01 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e73fc5f0-97c9-41b8-93f3-b63511cf5b9d tempest-GroupSnapshotsTest-773077248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:01 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e73fc5f0-97c9-41b8-93f3-b63511cf5b9d tempest-GroupSnapshotsTest-773077248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e73fc5f0-97c9-41b8-93f3-b63511cf5b9d tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:01 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e73fc5f0-97c9-41b8-93f3-b63511cf5b9d tempest-GroupSnapshotsTest-773077248 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:29:01 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-e73fc5f0-97c9-41b8-93f3-b63511cf5b9d tempest-GroupSnapshotsTest-773077248 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:29:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e73fc5f0-97c9-41b8-93f3-b63511cf5b9d tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:01 devstack sudo[86766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d 1073741824
Apr 02 10:29:01 devstack sudo[86766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:02 devstack sudo[86766]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e73fc5f0-97c9-41b8-93f3-b63511cf5b9d tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d 1073741824" returned: 0 in 0.555s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e73fc5f0-97c9-41b8-93f3-b63511cf5b9d tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:02 devstack sudo[86774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d
Apr 02 10:29:02 devstack sudo[86774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:02 devstack sudo[86774]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e73fc5f0-97c9-41b8-93f3-b63511cf5b9d tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d" returned: 0 in 0.565s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:02 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e73fc5f0-97c9-41b8-93f3-b63511cf5b9d tempest-GroupSnapshotsTest-773077248 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:29:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e73fc5f0-97c9-41b8-93f3-b63511cf5b9d tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:03 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e73fc5f0-97c9-41b8-93f3-b63511cf5b9d tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ea88c0-b5c1-46a4-a612-7b3c4ee53a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:03 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e73fc5f0-97c9-41b8-93f3-b63511cf5b9d tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d9a8163-4a68-452e-a4e9-9e77b3b6571f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:03 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-e73fc5f0-97c9-41b8-93f3-b63511cf5b9d tempest-GroupSnapshotsTest-773077248 None] Volume volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d (f9fb7d59-a6df-4105-9826-6bfca4c2784d): created successfully
Apr 02 10:29:03 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e73fc5f0-97c9-41b8-93f3-b63511cf5b9d tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d9a8163-4a68-452e-a4e9-9e77b3b6571f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:03 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e73fc5f0-97c9-41b8-93f3-b63511cf5b9d tempest-GroupSnapshotsTest-773077248 None] Flow 'volume_create_manager' (22a0efa4-7243-4087-aca0-486d54c14327) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:03 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-e73fc5f0-97c9-41b8-93f3-b63511cf5b9d tempest-GroupSnapshotsTest-773077248 None] Created volume successfully.
Apr 02 10:29:04 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-fbfe3bad-50fd-477b-a14c-49215b88596c tempest-GroupSnapshotsTest-773077248 None] Update group completed successfully.
Apr 02 10:29:05 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-fde981d6-2550-4828-89a8-87a20aac99bb tempest-GroupSnapshotsTest-773077248 None] Update group completed successfully.
Apr 02 10:29:05 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-2478c9be-4482-4cec-885f-4b828dde3599 tempest-VolumesTransfersV355Test-1772868082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:29:05 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-2478c9be-4482-4cec-885f-4b828dde3599 tempest-VolumesTransfersV355Test-1772868082 None] Flow 'volume_create_manager' (17001da1-9890-4d1a-93bb-9bcdeb804e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:05 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-2478c9be-4482-4cec-885f-4b828dde3599 tempest-VolumesTransfersV355Test-1772868082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e25bbb0-55ab-47e5-845a-ee4bdd39880c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:05 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-2478c9be-4482-4cec-885f-4b828dde3599 tempest-VolumesTransfersV355Test-1772868082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e25bbb0-55ab-47e5-845a-ee4bdd39880c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-20201613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f36853-c52f-4578-9495-8cbb0f1942d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9c502ce013742aca46b781d9b26d3be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:06Z,use_quota=True,user_id='801094195f1f4ed89fd0e43fd3f6b131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:05 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-2478c9be-4482-4cec-885f-4b828dde3599 tempest-VolumesTransfersV355Test-1772868082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (781fd583-6b98-4961-a527-c0463f2fafda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:05 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-2478c9be-4482-4cec-885f-4b828dde3599 tempest-VolumesTransfersV355Test-1772868082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (781fd583-6b98-4961-a527-c0463f2fafda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:06 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-2478c9be-4482-4cec-885f-4b828dde3599 tempest-VolumesTransfersV355Test-1772868082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38c7672e-24c1-40b2-b304-61fdc160b92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:06 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-2478c9be-4482-4cec-885f-4b828dde3599 tempest-VolumesTransfersV355Test-1772868082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38c7672e-24c1-40b2-b304-61fdc160b92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82f36853-c52f-4578-9495-8cbb0f1942d5', 'volume_name': 'volume-82f36853-c52f-4578-9495-8cbb0f1942d5', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:06 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-2478c9be-4482-4cec-885f-4b828dde3599 tempest-VolumesTransfersV355Test-1772868082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f157147f-fc22-40e1-8fa0-fc2519e65465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:06 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-2478c9be-4482-4cec-885f-4b828dde3599 tempest-VolumesTransfersV355Test-1772868082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f157147f-fc22-40e1-8fa0-fc2519e65465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:06 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-2478c9be-4482-4cec-885f-4b828dde3599 tempest-VolumesTransfersV355Test-1772868082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38667b2d-e250-413d-9f93-ca1d32eb80c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:06 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-2478c9be-4482-4cec-885f-4b828dde3599 tempest-VolumesTransfersV355Test-1772868082 None] Volume 82f36853-c52f-4578-9495-8cbb0f1942d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82f36853-c52f-4578-9495-8cbb0f1942d5', 'volume_size': 1}
Apr 02 10:29:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-2478c9be-4482-4cec-885f-4b828dde3599 tempest-VolumesTransfersV355Test-1772868082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-2478c9be-4482-4cec-885f-4b828dde3599 tempest-VolumesTransfersV355Test-1772868082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:06 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-2478c9be-4482-4cec-885f-4b828dde3599 tempest-VolumesTransfersV355Test-1772868082 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-20201613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f36853-c52f-4578-9495-8cbb0f1942d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9c502ce013742aca46b781d9b26d3be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:06Z,use_quota=True,user_id='801094195f1f4ed89fd0e43fd3f6b131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:29:06 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-2478c9be-4482-4cec-885f-4b828dde3599 tempest-VolumesTransfersV355Test-1772868082 None] Creating volume 82f36853-c52f-4578-9495-8cbb0f1942d5 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:29:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-2478c9be-4482-4cec-885f-4b828dde3599 tempest-VolumesTransfersV355Test-1772868082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-2478c9be-4482-4cec-885f-4b828dde3599 tempest-VolumesTransfersV355Test-1772868082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:06 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-2478c9be-4482-4cec-885f-4b828dde3599 tempest-VolumesTransfersV355Test-1772868082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:06 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-2478c9be-4482-4cec-885f-4b828dde3599 tempest-VolumesTransfersV355Test-1772868082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-2478c9be-4482-4cec-885f-4b828dde3599 tempest-VolumesTransfersV355Test-1772868082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:06 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-2478c9be-4482-4cec-885f-4b828dde3599 tempest-VolumesTransfersV355Test-1772868082 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:29:06 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-2478c9be-4482-4cec-885f-4b828dde3599 tempest-VolumesTransfersV355Test-1772868082 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:29:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2478c9be-4482-4cec-885f-4b828dde3599 tempest-VolumesTransfersV355Test-1772868082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-82f36853-c52f-4578-9495-8cbb0f1942d5 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:06 devstack sudo[86827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-82f36853-c52f-4578-9495-8cbb0f1942d5 1073741824
Apr 02 10:29:06 devstack sudo[86827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:06 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-f3407bec-4752-4a0f-94d9-e0ebba6b5a17 tempest-GroupSnapshotsTest-773077248 None] Update group completed successfully.
Apr 02 10:29:06 devstack sudo[86827]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2478c9be-4482-4cec-885f-4b828dde3599 tempest-VolumesTransfersV355Test-1772868082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-82f36853-c52f-4578-9495-8cbb0f1942d5 1073741824" returned: 0 in 0.680s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2478c9be-4482-4cec-885f-4b828dde3599 tempest-VolumesTransfersV355Test-1772868082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-82f36853-c52f-4578-9495-8cbb0f1942d5 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:06 devstack sudo[86835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-82f36853-c52f-4578-9495-8cbb0f1942d5
Apr 02 10:29:06 devstack sudo[86835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:07 devstack sudo[86835]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2478c9be-4482-4cec-885f-4b828dde3599 tempest-VolumesTransfersV355Test-1772868082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-82f36853-c52f-4578-9495-8cbb0f1942d5" returned: 0 in 0.445s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:07 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-2478c9be-4482-4cec-885f-4b828dde3599 tempest-VolumesTransfersV355Test-1772868082 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:29:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-2478c9be-4482-4cec-885f-4b828dde3599 tempest-VolumesTransfersV355Test-1772868082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:07 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-2478c9be-4482-4cec-885f-4b828dde3599 tempest-VolumesTransfersV355Test-1772868082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38667b2d-e250-413d-9f93-ca1d32eb80c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82f36853-c52f-4578-9495-8cbb0f1942d5', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:07 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-2478c9be-4482-4cec-885f-4b828dde3599 tempest-VolumesTransfersV355Test-1772868082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8073732f-e3f7-4eff-9502-2e31bc1ffb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:07 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-2478c9be-4482-4cec-885f-4b828dde3599 tempest-VolumesTransfersV355Test-1772868082 None] Volume volume-82f36853-c52f-4578-9495-8cbb0f1942d5 (82f36853-c52f-4578-9495-8cbb0f1942d5): created successfully
Apr 02 10:29:07 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-2478c9be-4482-4cec-885f-4b828dde3599 tempest-VolumesTransfersV355Test-1772868082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8073732f-e3f7-4eff-9502-2e31bc1ffb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:07 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-2478c9be-4482-4cec-885f-4b828dde3599 tempest-VolumesTransfersV355Test-1772868082 None] Flow 'volume_create_manager' (17001da1-9890-4d1a-93bb-9bcdeb804e17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:07 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-2478c9be-4482-4cec-885f-4b828dde3599 tempest-VolumesTransfersV355Test-1772868082 None] Created volume successfully.
Apr 02 10:29:07 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-ddceaaf7-6a67-48c7-929f-4a740d1acce7 tempest-GroupSnapshotsTest-773077248 None] Update group completed successfully.
Apr 02 10:29:08 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-04cec369-982b-4199-95ea-fe87636f89ec tempest-VolumesTransfersV355Test-1640868828 None] Transfer volume completed successfully.
Apr 02 10:29:08 devstack cinder-volume[82102]: DEBUG oslo_service.periodic_task [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 02 10:29:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:08 devstack sudo[86866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:29:08 devstack sudo[86866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:09 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] GroupSnapshot d1c36679-ddef-430e-9fdd-93772875a481: creating.
Apr 02 10:29:09 devstack sudo[86866]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.681s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:09 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:29:09 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] Group snapshot d1c36679-ddef-430e-9fdd-93772875a481: creating. {{(pid=82102) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 02 10:29:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:09 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] Creating offline snapshot 07c3d29a-39dc-470c-a93b-5df3ffe195b0 of volume 2b8c6fa7-e201-426e-a693-0d605a634a00 {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:29:09 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-69c2694d-9c8d-41a1-bc2b-79f0ca4c06bd tempest-VolumesTransfersV355Test-720670345 None] Acquiring lock "cinder-82f36853-c52f-4578-9495-8cbb0f1942d5-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:09 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51d9796-7e3b-47d6-93cc-68813bce68d3]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:29:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:09 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-69c2694d-9c8d-41a1-bc2b-79f0ca4c06bd tempest-VolumesTransfersV355Test-720670345 None] Lock "cinder-82f36853-c52f-4578-9495-8cbb0f1942d5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:09 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-69c2694d-9c8d-41a1-bc2b-79f0ca4c06bd tempest-VolumesTransfersV355Test-720670345 None] Acquiring lock "cinder-quobyte-82f36853-c52f-4578-9495-8cbb0f1942d5" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:09 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-69c2694d-9c8d-41a1-bc2b-79f0ca4c06bd tempest-VolumesTransfersV355Test-720670345 None] Lock "cinder-quobyte-82f36853-c52f-4578-9495-8cbb0f1942d5" acquired by "delete_volume" :: waited 0.011s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:09 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71bdd55-8d9f-4ca5-81cf-df79cde49113]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:29:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-69c2694d-9c8d-41a1-bc2b-79f0ca4c06bd tempest-VolumesTransfersV355Test-720670345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-82f36853-c52f-4578-9495-8cbb0f1942d5 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:09 devstack sudo[86870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00
Apr 02 10:29:09 devstack sudo[86870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:09 devstack sudo[86871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-82f36853-c52f-4578-9495-8cbb0f1942d5
Apr 02 10:29:09 devstack sudo[86871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:09 devstack sudo[86870]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00" returned: 0 in 0.524s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00.07c3d29a-39dc-470c-a93b-5df3ffe195b0 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:09 devstack sudo[86880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00.07c3d29a-39dc-470c-a93b-5df3ffe195b0 1G
Apr 02 10:29:09 devstack sudo[86880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:09 devstack sudo[86871]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-69c2694d-9c8d-41a1-bc2b-79f0ca4c06bd tempest-VolumesTransfersV355Test-720670345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-82f36853-c52f-4578-9495-8cbb0f1942d5" returned: 0 in 0.507s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-69c2694d-9c8d-41a1-bc2b-79f0ca4c06bd tempest-VolumesTransfersV355Test-720670345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-82f36853-c52f-4578-9495-8cbb0f1942d5 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:09 devstack sudo[86882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-82f36853-c52f-4578-9495-8cbb0f1942d5
Apr 02 10:29:09 devstack sudo[86882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:10 devstack sudo[86882]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-69c2694d-9c8d-41a1-bc2b-79f0ca4c06bd tempest-VolumesTransfersV355Test-720670345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-82f36853-c52f-4578-9495-8cbb0f1942d5" returned: 0 in 0.688s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:10 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-69c2694d-9c8d-41a1-bc2b-79f0ca4c06bd tempest-VolumesTransfersV355Test-720670345 None] Lock "cinder-quobyte-82f36853-c52f-4578-9495-8cbb0f1942d5" released by "delete_volume" :: held 1.225s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:10 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-69c2694d-9c8d-41a1-bc2b-79f0ca4c06bd tempest-VolumesTransfersV355Test-720670345 None] Created reservations ['4c487608-d9d5-4f97-8a88-b118fc8376c6', 'b54d898a-44f0-4265-99f8-50ca6912f225', '4b2cb1ae-7617-4cd7-9b49-65d2654b7939', 'faabfe2f-e836-4bc6-8656-7052f7257e42'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:29:10 devstack sudo[86880]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00.07c3d29a-39dc-470c-a93b-5df3ffe195b0 1G" returned: 0 in 0.898s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b8c6fa7-e201-426e-a693-0d605a634a00 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00.07c3d29a-39dc-470c-a93b-5df3ffe195b0 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-69c2694d-9c8d-41a1-bc2b-79f0ca4c06bd tempest-VolumesTransfersV355Test-720670345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-69c2694d-9c8d-41a1-bc2b-79f0ca4c06bd tempest-VolumesTransfersV355Test-720670345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:10 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-69c2694d-9c8d-41a1-bc2b-79f0ca4c06bd tempest-VolumesTransfersV355Test-720670345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:10 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-69c2694d-9c8d-41a1-bc2b-79f0ca4c06bd tempest-VolumesTransfersV355Test-720670345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-69c2694d-9c8d-41a1-bc2b-79f0ca4c06bd tempest-VolumesTransfersV355Test-720670345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-69c2694d-9c8d-41a1-bc2b-79f0ca4c06bd tempest-VolumesTransfersV355Test-720670345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:10 devstack sudo[86912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b8c6fa7-e201-426e-a693-0d605a634a00 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00.07c3d29a-39dc-470c-a93b-5df3ffe195b0
Apr 02 10:29:10 devstack sudo[86912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:10 devstack sudo[86913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:29:10 devstack sudo[86913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:11 devstack sudo[86912]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b8c6fa7-e201-426e-a693-0d605a634a00 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00.07c3d29a-39dc-470c-a93b-5df3ffe195b0" returned: 0 in 0.438s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:11 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00.07c3d29a-39dc-470c-a93b-5df3ffe195b0 is being set with open permissions: ugo+rw: NotImplementedError
Apr 02 10:29:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00.07c3d29a-39dc-470c-a93b-5df3ffe195b0 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:11 devstack sudo[86913]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:11 devstack sudo[86922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00.07c3d29a-39dc-470c-a93b-5df3ffe195b0
Apr 02 10:29:11 devstack sudo[86922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-69c2694d-9c8d-41a1-bc2b-79f0ca4c06bd tempest-VolumesTransfersV355Test-720670345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.443s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:11 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-69c2694d-9c8d-41a1-bc2b-79f0ca4c06bd tempest-VolumesTransfersV355Test-720670345 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:29:11 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-69c2694d-9c8d-41a1-bc2b-79f0ca4c06bd tempest-VolumesTransfersV355Test-720670345 None] Deleted volume successfully.
Apr 02 10:29:11 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-69c2694d-9c8d-41a1-bc2b-79f0ca4c06bd tempest-VolumesTransfersV355Test-720670345 None] Lock "cinder-82f36853-c52f-4578-9495-8cbb0f1942d5-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:11 devstack sudo[86922]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00.07c3d29a-39dc-470c-a93b-5df3ffe195b0" returned: 0 in 0.458s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:11 devstack sudo[86925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00.info
Apr 02 10:29:11 devstack sudo[86925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:11 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-17e3ce06-c333-49bd-afd6-922e38496e1f tempest-VolumesTransfersV355Test-1772868082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:29:11 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-17e3ce06-c333-49bd-afd6-922e38496e1f tempest-VolumesTransfersV355Test-1772868082 None] Flow 'volume_create_manager' (0bc54ee3-f0ac-46f5-ba2a-c1c08959d84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:11 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-17e3ce06-c333-49bd-afd6-922e38496e1f tempest-VolumesTransfersV355Test-1772868082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81290f47-359e-4b60-a4b9-b57c40ee75d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:11 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-17e3ce06-c333-49bd-afd6-922e38496e1f tempest-VolumesTransfersV355Test-1772868082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81290f47-359e-4b60-a4b9-b57c40ee75d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1213652646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8a05191-8437-4d60-a6ea-0b1d785eff91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9c502ce013742aca46b781d9b26d3be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:12Z,use_quota=True,user_id='801094195f1f4ed89fd0e43fd3f6b131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:11 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-17e3ce06-c333-49bd-afd6-922e38496e1f tempest-VolumesTransfersV355Test-1772868082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a67df7c-8d0f-4cdc-806c-9a4e0c6746e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:11 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-17e3ce06-c333-49bd-afd6-922e38496e1f tempest-VolumesTransfersV355Test-1772868082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a67df7c-8d0f-4cdc-806c-9a4e0c6746e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:11 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-17e3ce06-c333-49bd-afd6-922e38496e1f tempest-VolumesTransfersV355Test-1772868082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d033a152-c26b-415e-b74a-405a5c355f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:11 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-17e3ce06-c333-49bd-afd6-922e38496e1f tempest-VolumesTransfersV355Test-1772868082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d033a152-c26b-415e-b74a-405a5c355f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8a05191-8437-4d60-a6ea-0b1d785eff91', 'volume_name': 'volume-a8a05191-8437-4d60-a6ea-0b1d785eff91', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:12 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-17e3ce06-c333-49bd-afd6-922e38496e1f tempest-VolumesTransfersV355Test-1772868082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be27766-e61b-4d4d-9d15-f31d3c05ea35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:12 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-17e3ce06-c333-49bd-afd6-922e38496e1f tempest-VolumesTransfersV355Test-1772868082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be27766-e61b-4d4d-9d15-f31d3c05ea35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:12 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-17e3ce06-c333-49bd-afd6-922e38496e1f tempest-VolumesTransfersV355Test-1772868082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3915677a-632e-4e7c-8946-6a5066b1e656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:12 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-17e3ce06-c333-49bd-afd6-922e38496e1f tempest-VolumesTransfersV355Test-1772868082 None] Volume a8a05191-8437-4d60-a6ea-0b1d785eff91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8a05191-8437-4d60-a6ea-0b1d785eff91', 'volume_size': 1}
Apr 02 10:29:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-17e3ce06-c333-49bd-afd6-922e38496e1f tempest-VolumesTransfersV355Test-1772868082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:12 devstack sudo[86925]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00.info" returned: 0 in 0.511s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:12 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 02 10:29:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:12 devstack sudo[86928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00.info
Apr 02 10:29:12 devstack sudo[86928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:12 devstack sudo[86928]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00.info" returned: 0 in 0.517s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.416s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:12 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] Creating offline snapshot 422f679f-6a64-4bb8-9833-51afdbc12874 of volume f9fb7d59-a6df-4105-9826-6bfca4c2784d {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:29:12 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af3f9d2-f3f9-45bc-b378-32ae742cc523]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:29:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:12 devstack sudo[86931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d
Apr 02 10:29:12 devstack sudo[86931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:13 devstack sudo[86931]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d" returned: 0 in 0.561s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d.422f679f-6a64-4bb8-9833-51afdbc12874 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:13 devstack sudo[86936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d.422f679f-6a64-4bb8-9833-51afdbc12874 1G
Apr 02 10:29:13 devstack sudo[86936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:13 devstack sudo[86936]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d.422f679f-6a64-4bb8-9833-51afdbc12874 1G" returned: 0 in 0.618s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d.422f679f-6a64-4bb8-9833-51afdbc12874 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:14 devstack sudo[86941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d.422f679f-6a64-4bb8-9833-51afdbc12874
Apr 02 10:29:14 devstack sudo[86941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:14 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-330c6e45-e32d-44c4-aca7-d3189e662e6d tempest-VolumesActionsTest-1099538795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:29:14 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-330c6e45-e32d-44c4-aca7-d3189e662e6d tempest-VolumesActionsTest-1099538795 None] Flow 'volume_create_manager' (d37d1355-1dc5-4741-8bf2-2cb59ad659d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:14 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-330c6e45-e32d-44c4-aca7-d3189e662e6d tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f499aeb7-510b-4fc8-b79e-b3bf658af4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:14 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-330c6e45-e32d-44c4-aca7-d3189e662e6d tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f499aeb7-510b-4fc8-b79e-b3bf658af4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1206230290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92cd48ebe8bf4c4d8acbf4c15968d823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:14Z,use_quota=True,user_id='1e0b000a1a39462998b46dd57ca6b695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:14 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-330c6e45-e32d-44c4-aca7-d3189e662e6d tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f373ce-97d4-49f0-9437-2c4c730e9ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:14 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-330c6e45-e32d-44c4-aca7-d3189e662e6d tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f373ce-97d4-49f0-9437-2c4c730e9ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:14 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-330c6e45-e32d-44c4-aca7-d3189e662e6d tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95e571c5-d9f7-4a0a-b3f4-5616f7ac6365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:14 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-330c6e45-e32d-44c4-aca7-d3189e662e6d tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95e571c5-d9f7-4a0a-b3f4-5616f7ac6365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3a6908e-fadf-4c70-b27c-0fb14a4b6a0a', 'volume_name': 'volume-d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:14 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-330c6e45-e32d-44c4-aca7-d3189e662e6d tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7c19b19-72ae-46f5-bfce-b9072ab01b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:14 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-330c6e45-e32d-44c4-aca7-d3189e662e6d tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7c19b19-72ae-46f5-bfce-b9072ab01b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:14 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-330c6e45-e32d-44c4-aca7-d3189e662e6d tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (927ff923-daee-49c1-af51-bab7cb55a39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:14 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-330c6e45-e32d-44c4-aca7-d3189e662e6d tempest-VolumesActionsTest-1099538795 None] Volume d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a', 'volume_size': 1}
Apr 02 10:29:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-330c6e45-e32d-44c4-aca7-d3189e662e6d tempest-VolumesActionsTest-1099538795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:14 devstack sudo[86941]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d.422f679f-6a64-4bb8-9833-51afdbc12874" returned: 0 in 0.553s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:14 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d.422f679f-6a64-4bb8-9833-51afdbc12874 is being set with open permissions: ugo+rw: NotImplementedError
Apr 02 10:29:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d.422f679f-6a64-4bb8-9833-51afdbc12874 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:14 devstack sudo[86947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d.422f679f-6a64-4bb8-9833-51afdbc12874
Apr 02 10:29:14 devstack sudo[86947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:14 devstack sudo[86947]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d.422f679f-6a64-4bb8-9833-51afdbc12874" returned: 0 in 0.475s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:15 devstack sudo[86951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d.info
Apr 02 10:29:15 devstack sudo[86951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:15 devstack sudo[86951]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d.info" returned: 0 in 0.453s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:15 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 02 10:29:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:15 devstack sudo[86954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d.info
Apr 02 10:29:15 devstack sudo[86954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:15 devstack sudo[86954]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d.info" returned: 0 in 0.447s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.175s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-17e3ce06-c333-49bd-afd6-922e38496e1f tempest-VolumesTransfersV355Test-1772868082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.921s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-17e3ce06-c333-49bd-afd6-922e38496e1f tempest-VolumesTransfersV355Test-1772868082 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1213652646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8a05191-8437-4d60-a6ea-0b1d785eff91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9c502ce013742aca46b781d9b26d3be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:12Z,use_quota=True,user_id='801094195f1f4ed89fd0e43fd3f6b131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:29:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-17e3ce06-c333-49bd-afd6-922e38496e1f tempest-VolumesTransfersV355Test-1772868082 None] Creating volume a8a05191-8437-4d60-a6ea-0b1d785eff91 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:29:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-17e3ce06-c333-49bd-afd6-922e38496e1f tempest-VolumesTransfersV355Test-1772868082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-17e3ce06-c333-49bd-afd6-922e38496e1f tempest-VolumesTransfersV355Test-1772868082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-17e3ce06-c333-49bd-afd6-922e38496e1f tempest-VolumesTransfersV355Test-1772868082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-17e3ce06-c333-49bd-afd6-922e38496e1f tempest-VolumesTransfersV355Test-1772868082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-17e3ce06-c333-49bd-afd6-922e38496e1f tempest-VolumesTransfersV355Test-1772868082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-17e3ce06-c333-49bd-afd6-922e38496e1f tempest-VolumesTransfersV355Test-1772868082 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:29:15 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-17e3ce06-c333-49bd-afd6-922e38496e1f tempest-VolumesTransfersV355Test-1772868082 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:29:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-17e3ce06-c333-49bd-afd6-922e38496e1f tempest-VolumesTransfersV355Test-1772868082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8a05191-8437-4d60-a6ea-0b1d785eff91 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:15 devstack sudo[86957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8a05191-8437-4d60-a6ea-0b1d785eff91 1073741824
Apr 02 10:29:15 devstack sudo[86957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:16 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-ac37b739-8871-4a2d-b249-061f85e260d1 tempest-GroupSnapshotsTest-773077248 None] group_snapshot d1c36679-ddef-430e-9fdd-93772875a481: created successfully
Apr 02 10:29:16 devstack sudo[86957]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-17e3ce06-c333-49bd-afd6-922e38496e1f tempest-VolumesTransfersV355Test-1772868082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8a05191-8437-4d60-a6ea-0b1d785eff91 1073741824" returned: 0 in 0.666s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-17e3ce06-c333-49bd-afd6-922e38496e1f tempest-VolumesTransfersV355Test-1772868082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8a05191-8437-4d60-a6ea-0b1d785eff91 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:16 devstack sudo[86962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8a05191-8437-4d60-a6ea-0b1d785eff91
Apr 02 10:29:16 devstack sudo[86962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:16 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] group_snapshot d1c36679-ddef-430e-9fdd-93772875a481: deleting
Apr 02 10:29:16 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] group_snapshot d1c36679-ddef-430e-9fdd-93772875a481: deleting {{(pid=82102) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 02 10:29:16 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] Acquiring lock "cinder-quobyte-2b8c6fa7-e201-426e-a693-0d605a634a00" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:16 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] Lock "cinder-quobyte-2b8c6fa7-e201-426e-a693-0d605a634a00" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:16 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] Acquiring lock "cinder-quobyte-07c3d29a-39dc-470c-a93b-5df3ffe195b0" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:16 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] Lock "cinder-quobyte-07c3d29a-39dc-470c-a93b-5df3ffe195b0" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:16 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] Deleting offline snapshot 07c3d29a-39dc-470c-a93b-5df3ffe195b0 of volume 2b8c6fa7-e201-426e-a693-0d605a634a00 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:29:16 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] snapshot_file for this snap is: volume-2b8c6fa7-e201-426e-a693-0d605a634a00.07c3d29a-39dc-470c-a93b-5df3ffe195b0 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:29:16 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35d4de8-0676-4814-9986-8a6e3a3add8a]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:29:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00.07c3d29a-39dc-470c-a93b-5df3ffe195b0 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:16 devstack sudo[86964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00.07c3d29a-39dc-470c-a93b-5df3ffe195b0
Apr 02 10:29:16 devstack sudo[86964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:17 devstack sudo[86962]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-17e3ce06-c333-49bd-afd6-922e38496e1f tempest-VolumesTransfersV355Test-1772868082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8a05191-8437-4d60-a6ea-0b1d785eff91" returned: 0 in 0.657s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:17 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-17e3ce06-c333-49bd-afd6-922e38496e1f tempest-VolumesTransfersV355Test-1772868082 None] <== create_volume: return (1365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:29:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-17e3ce06-c333-49bd-afd6-922e38496e1f tempest-VolumesTransfersV355Test-1772868082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.370s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-330c6e45-e32d-44c4-aca7-d3189e662e6d tempest-VolumesActionsTest-1099538795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.990s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:17 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-330c6e45-e32d-44c4-aca7-d3189e662e6d tempest-VolumesActionsTest-1099538795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1206230290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92cd48ebe8bf4c4d8acbf4c15968d823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:14Z,use_quota=True,user_id='1e0b000a1a39462998b46dd57ca6b695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:29:17 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-330c6e45-e32d-44c4-aca7-d3189e662e6d tempest-VolumesActionsTest-1099538795 None] Creating volume d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:29:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-330c6e45-e32d-44c4-aca7-d3189e662e6d tempest-VolumesActionsTest-1099538795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-330c6e45-e32d-44c4-aca7-d3189e662e6d tempest-VolumesActionsTest-1099538795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:17 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-330c6e45-e32d-44c4-aca7-d3189e662e6d tempest-VolumesActionsTest-1099538795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:17 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-330c6e45-e32d-44c4-aca7-d3189e662e6d tempest-VolumesActionsTest-1099538795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-330c6e45-e32d-44c4-aca7-d3189e662e6d tempest-VolumesActionsTest-1099538795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:17 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-330c6e45-e32d-44c4-aca7-d3189e662e6d tempest-VolumesActionsTest-1099538795 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:29:17 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-330c6e45-e32d-44c4-aca7-d3189e662e6d tempest-VolumesActionsTest-1099538795 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:29:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-330c6e45-e32d-44c4-aca7-d3189e662e6d tempest-VolumesActionsTest-1099538795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:17 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1353e531-81ec-4dfe-ab83-62e9780442ae tempest-VolumesNegativeTest-723577322 None] Acquiring lock "cinder-33aa3aee-6015-4f0e-8811-b0a30cc80742-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:17 devstack sudo[86967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a 1073741824
Apr 02 10:29:17 devstack sudo[86967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:17 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-17e3ce06-c333-49bd-afd6-922e38496e1f tempest-VolumesTransfersV355Test-1772868082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3915677a-632e-4e7c-8946-6a5066b1e656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8a05191-8437-4d60-a6ea-0b1d785eff91', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:17 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-17e3ce06-c333-49bd-afd6-922e38496e1f tempest-VolumesTransfersV355Test-1772868082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca968c6b-4b7d-415d-bb7d-9445b25ecad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:17 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-17e3ce06-c333-49bd-afd6-922e38496e1f tempest-VolumesTransfersV355Test-1772868082 None] Volume volume-a8a05191-8437-4d60-a6ea-0b1d785eff91 (a8a05191-8437-4d60-a6ea-0b1d785eff91): created successfully
Apr 02 10:29:17 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-17e3ce06-c333-49bd-afd6-922e38496e1f tempest-VolumesTransfersV355Test-1772868082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca968c6b-4b7d-415d-bb7d-9445b25ecad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:17 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-17e3ce06-c333-49bd-afd6-922e38496e1f tempest-VolumesTransfersV355Test-1772868082 None] Flow 'volume_create_manager' (0bc54ee3-f0ac-46f5-ba2a-c1c08959d84e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:17 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1353e531-81ec-4dfe-ab83-62e9780442ae tempest-VolumesNegativeTest-723577322 None] Lock "cinder-33aa3aee-6015-4f0e-8811-b0a30cc80742-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:17 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-17e3ce06-c333-49bd-afd6-922e38496e1f tempest-VolumesTransfersV355Test-1772868082 None] Created volume successfully.
Apr 02 10:29:17 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1353e531-81ec-4dfe-ab83-62e9780442ae tempest-VolumesNegativeTest-723577322 None] Acquiring lock "cinder-quobyte-33aa3aee-6015-4f0e-8811-b0a30cc80742" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:17 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1353e531-81ec-4dfe-ab83-62e9780442ae tempest-VolumesNegativeTest-723577322 None] Lock "cinder-quobyte-33aa3aee-6015-4f0e-8811-b0a30cc80742" acquired by "delete_volume" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:17 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eac41e8-445b-4917-bc43-dd72841c321b]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:29:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1353e531-81ec-4dfe-ab83-62e9780442ae tempest-VolumesNegativeTest-723577322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33aa3aee-6015-4f0e-8811-b0a30cc80742 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:17 devstack sudo[86964]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00.07c3d29a-39dc-470c-a93b-5df3ffe195b0" returned: 0 in 0.641s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:17 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b8c6fa7-e201-426e-a693-0d605a634a00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:29:17 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c460c729-1cb2-4f5d-928f-d70a02e334b8]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:29:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:17 devstack sudo[86972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33aa3aee-6015-4f0e-8811-b0a30cc80742
Apr 02 10:29:17 devstack sudo[86972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:17 devstack sudo[86973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00
Apr 02 10:29:17 devstack sudo[86973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:17 devstack sudo[86967]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-330c6e45-e32d-44c4-aca7-d3189e662e6d tempest-VolumesActionsTest-1099538795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a 1073741824" returned: 0 in 0.622s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:17 devstack sudo[86972]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1353e531-81ec-4dfe-ab83-62e9780442ae tempest-VolumesNegativeTest-723577322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33aa3aee-6015-4f0e-8811-b0a30cc80742" returned: 0 in 0.499s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1353e531-81ec-4dfe-ab83-62e9780442ae tempest-VolumesNegativeTest-723577322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33aa3aee-6015-4f0e-8811-b0a30cc80742 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:17 devstack sudo[86985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33aa3aee-6015-4f0e-8811-b0a30cc80742
Apr 02 10:29:17 devstack sudo[86985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-330c6e45-e32d-44c4-aca7-d3189e662e6d tempest-VolumesActionsTest-1099538795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:18 devstack sudo[86987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a
Apr 02 10:29:18 devstack sudo[86987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:18 devstack sudo[86973]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00" returned: 0 in 0.531s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00.07c3d29a-39dc-470c-a93b-5df3ffe195b0 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:18 devstack sudo[86989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00.07c3d29a-39dc-470c-a93b-5df3ffe195b0
Apr 02 10:29:18 devstack sudo[86989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:18 devstack sudo[86985]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1353e531-81ec-4dfe-ab83-62e9780442ae tempest-VolumesNegativeTest-723577322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33aa3aee-6015-4f0e-8811-b0a30cc80742" returned: 0 in 0.562s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:18 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1353e531-81ec-4dfe-ab83-62e9780442ae tempest-VolumesNegativeTest-723577322 None] Lock "cinder-quobyte-33aa3aee-6015-4f0e-8811-b0a30cc80742" released by "delete_volume" :: held 1.088s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:18 devstack sudo[86987]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-330c6e45-e32d-44c4-aca7-d3189e662e6d tempest-VolumesActionsTest-1099538795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a" returned: 0 in 0.561s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:18 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-330c6e45-e32d-44c4-aca7-d3189e662e6d tempest-VolumesActionsTest-1099538795 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:29:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-330c6e45-e32d-44c4-aca7-d3189e662e6d tempest-VolumesActionsTest-1099538795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-330c6e45-e32d-44c4-aca7-d3189e662e6d tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (927ff923-daee-49c1-af51-bab7cb55a39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-330c6e45-e32d-44c4-aca7-d3189e662e6d tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c22c556d-bd8f-4598-a8d9-9b8f01bbe5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:18 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-330c6e45-e32d-44c4-aca7-d3189e662e6d tempest-VolumesActionsTest-1099538795 None] Volume volume-d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a (d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a): created successfully
Apr 02 10:29:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-330c6e45-e32d-44c4-aca7-d3189e662e6d tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c22c556d-bd8f-4598-a8d9-9b8f01bbe5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-330c6e45-e32d-44c4-aca7-d3189e662e6d tempest-VolumesActionsTest-1099538795 None] Flow 'volume_create_manager' (d37d1355-1dc5-4741-8bf2-2cb59ad659d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:18 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-330c6e45-e32d-44c4-aca7-d3189e662e6d tempest-VolumesActionsTest-1099538795 None] Created volume successfully.
Apr 02 10:29:18 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-1353e531-81ec-4dfe-ab83-62e9780442ae tempest-VolumesNegativeTest-723577322 None] Created reservations ['c192583a-3bb0-4c26-bc8a-65c95122fb94', 'b9eb89ea-110e-4d25-89b6-dc46045f7528', 'c6af3c3a-e0ef-4e99-8b72-37eaec7029ee', '7043e5ca-4e3c-48c7-afd0-45e647d87bb2'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:29:18 devstack sudo[86989]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00.07c3d29a-39dc-470c-a93b-5df3ffe195b0" returned: 0 in 0.610s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00.07c3d29a-39dc-470c-a93b-5df3ffe195b0 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:18 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-ce64db81-1b9c-4dc1-9e59-662da64af0be tempest-VolumesTransfersV355Test-720670345 None] Acquiring lock "cinder-a8a05191-8437-4d60-a6ea-0b1d785eff91-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:18 devstack sudo[86996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00.07c3d29a-39dc-470c-a93b-5df3ffe195b0
Apr 02 10:29:18 devstack sudo[86996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:18 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-ce64db81-1b9c-4dc1-9e59-662da64af0be tempest-VolumesTransfersV355Test-720670345 None] Lock "cinder-a8a05191-8437-4d60-a6ea-0b1d785eff91-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:18 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-ce64db81-1b9c-4dc1-9e59-662da64af0be tempest-VolumesTransfersV355Test-720670345 None] Acquiring lock "cinder-quobyte-a8a05191-8437-4d60-a6ea-0b1d785eff91" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:18 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-ce64db81-1b9c-4dc1-9e59-662da64af0be tempest-VolumesTransfersV355Test-720670345 None] Lock "cinder-quobyte-a8a05191-8437-4d60-a6ea-0b1d785eff91" acquired by "delete_volume" :: waited 0.014s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:18 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13e82d1-5c55-49bf-bba5-466c9213ca45]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:29:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ce64db81-1b9c-4dc1-9e59-662da64af0be tempest-VolumesTransfersV355Test-720670345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8a05191-8437-4d60-a6ea-0b1d785eff91 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-1353e531-81ec-4dfe-ab83-62e9780442ae tempest-VolumesNegativeTest-723577322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-1353e531-81ec-4dfe-ab83-62e9780442ae tempest-VolumesNegativeTest-723577322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:18 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-1353e531-81ec-4dfe-ab83-62e9780442ae tempest-VolumesNegativeTest-723577322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:18 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-1353e531-81ec-4dfe-ab83-62e9780442ae tempest-VolumesNegativeTest-723577322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-1353e531-81ec-4dfe-ab83-62e9780442ae tempest-VolumesNegativeTest-723577322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1353e531-81ec-4dfe-ab83-62e9780442ae tempest-VolumesNegativeTest-723577322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:18 devstack sudo[86999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:29:18 devstack sudo[86999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:18 devstack sudo[86998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8a05191-8437-4d60-a6ea-0b1d785eff91
Apr 02 10:29:18 devstack sudo[86998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:19 devstack sudo[86996]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00.07c3d29a-39dc-470c-a93b-5df3ffe195b0" returned: 0 in 0.448s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:19 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] Lock "cinder-quobyte-07c3d29a-39dc-470c-a93b-5df3ffe195b0" released by "_delete_snapshot" :: held 2.313s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:19 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] Lock "cinder-quobyte-2b8c6fa7-e201-426e-a693-0d605a634a00" released by "delete_snapshot" :: held 2.324s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:19 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] Acquiring lock "cinder-quobyte-f9fb7d59-a6df-4105-9826-6bfca4c2784d" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:19 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] Lock "cinder-quobyte-f9fb7d59-a6df-4105-9826-6bfca4c2784d" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:19 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] Acquiring lock "cinder-quobyte-422f679f-6a64-4bb8-9833-51afdbc12874" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:19 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] Lock "cinder-quobyte-422f679f-6a64-4bb8-9833-51afdbc12874" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:19 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] Deleting offline snapshot 422f679f-6a64-4bb8-9833-51afdbc12874 of volume f9fb7d59-a6df-4105-9826-6bfca4c2784d {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:29:19 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] snapshot_file for this snap is: volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d.422f679f-6a64-4bb8-9833-51afdbc12874 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:29:19 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[cece428f-88ae-40b5-a7ea-ab8f702addb2]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:29:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d.422f679f-6a64-4bb8-9833-51afdbc12874 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:19 devstack sudo[86999]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1353e531-81ec-4dfe-ab83-62e9780442ae tempest-VolumesNegativeTest-723577322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.452s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:19 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-1353e531-81ec-4dfe-ab83-62e9780442ae tempest-VolumesNegativeTest-723577322 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:29:19 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-1353e531-81ec-4dfe-ab83-62e9780442ae tempest-VolumesNegativeTest-723577322 None] Deleted volume successfully.
Apr 02 10:29:19 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1353e531-81ec-4dfe-ab83-62e9780442ae tempest-VolumesNegativeTest-723577322 None] Lock "cinder-33aa3aee-6015-4f0e-8811-b0a30cc80742-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:19 devstack sudo[86998]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ce64db81-1b9c-4dc1-9e59-662da64af0be tempest-VolumesTransfersV355Test-720670345 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8a05191-8437-4d60-a6ea-0b1d785eff91" returned: 0 in 0.509s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ce64db81-1b9c-4dc1-9e59-662da64af0be tempest-VolumesTransfersV355Test-720670345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8a05191-8437-4d60-a6ea-0b1d785eff91 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:19 devstack sudo[87007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d.422f679f-6a64-4bb8-9833-51afdbc12874
Apr 02 10:29:19 devstack sudo[87007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:19 devstack sudo[87009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8a05191-8437-4d60-a6ea-0b1d785eff91
Apr 02 10:29:19 devstack sudo[87009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:19 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f38aed2d-64fd-4fe3-adde-72320ec58a3c tempest-VolumesActionsTest-1099538795 None] Acquiring lock "cinder-d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a" by "attach_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:19 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f38aed2d-64fd-4fe3-adde-72320ec58a3c tempest-VolumesActionsTest-1099538795 None] Lock "cinder-d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a" acquired by "attach_volume" :: waited 0.014s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:19 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-f38aed2d-64fd-4fe3-adde-72320ec58a3c tempest-VolumesActionsTest-1099538795 None] Attaching volume d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a to instance 73f4aa04-ffad-4941-85a9-d61cf641468f at mountpoint /dev/vdb on host None.
Apr 02 10:29:19 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-f38aed2d-64fd-4fe3-adde-72320ec58a3c tempest-VolumesActionsTest-1099538795 None] Attach volume completed successfully.
Apr 02 10:29:19 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f38aed2d-64fd-4fe3-adde-72320ec58a3c tempest-VolumesActionsTest-1099538795 None] Lock "cinder-d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a" released by "attach_volume" :: held 0.110s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:19 devstack sudo[87007]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d.422f679f-6a64-4bb8-9833-51afdbc12874" returned: 0 in 0.630s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:19 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:29:19 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19568b8-52b3-4921-aeb2-a9933110a9d1]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:29:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:19 devstack sudo[87009]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ce64db81-1b9c-4dc1-9e59-662da64af0be tempest-VolumesTransfersV355Test-720670345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8a05191-8437-4d60-a6ea-0b1d785eff91" returned: 0 in 0.608s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:19 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-ce64db81-1b9c-4dc1-9e59-662da64af0be tempest-VolumesTransfersV355Test-720670345 None] Lock "cinder-quobyte-a8a05191-8437-4d60-a6ea-0b1d785eff91" released by "delete_volume" :: held 1.147s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:19 devstack sudo[87015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d
Apr 02 10:29:19 devstack sudo[87015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:19 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-ce64db81-1b9c-4dc1-9e59-662da64af0be tempest-VolumesTransfersV355Test-720670345 None] Created reservations ['0cf9ed2e-18c9-4f9e-9cb8-9106d24fa8cd', 'c3262048-2df4-44b0-8807-b9cefa00f40c', '86c31901-394d-4ea5-9d0c-fa7994ead2f7', '32750660-25de-41d3-9d8c-af68af9d5d5d'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:29:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ce64db81-1b9c-4dc1-9e59-662da64af0be tempest-VolumesTransfersV355Test-720670345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ce64db81-1b9c-4dc1-9e59-662da64af0be tempest-VolumesTransfersV355Test-720670345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:19 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-ce64db81-1b9c-4dc1-9e59-662da64af0be tempest-VolumesTransfersV355Test-720670345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:19 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-ce64db81-1b9c-4dc1-9e59-662da64af0be tempest-VolumesTransfersV355Test-720670345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ce64db81-1b9c-4dc1-9e59-662da64af0be tempest-VolumesTransfersV355Test-720670345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ce64db81-1b9c-4dc1-9e59-662da64af0be tempest-VolumesTransfersV355Test-720670345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:19 devstack sudo[87017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:29:19 devstack sudo[87017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:20 devstack sudo[87015]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d" returned: 0 in 0.650s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d.422f679f-6a64-4bb8-9833-51afdbc12874 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:20 devstack sudo[87023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d.422f679f-6a64-4bb8-9833-51afdbc12874
Apr 02 10:29:20 devstack sudo[87023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:20 devstack sudo[87017]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ce64db81-1b9c-4dc1-9e59-662da64af0be tempest-VolumesTransfersV355Test-720670345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.693s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:20 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-ce64db81-1b9c-4dc1-9e59-662da64af0be tempest-VolumesTransfersV355Test-720670345 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:29:20 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-ce64db81-1b9c-4dc1-9e59-662da64af0be tempest-VolumesTransfersV355Test-720670345 None] Deleted volume successfully.
Apr 02 10:29:20 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-ce64db81-1b9c-4dc1-9e59-662da64af0be tempest-VolumesTransfersV355Test-720670345 None] Lock "cinder-a8a05191-8437-4d60-a6ea-0b1d785eff91-delete_volume" released by "delete_volume" :: held 2.009s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:20 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-f1a425b9-f062-4311-800c-982ae191b71a tempest-VolumesActionsTest-2043573547 None] Terminate volume connection completed successfully.
Apr 02 10:29:21 devstack sudo[87023]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d.422f679f-6a64-4bb8-9833-51afdbc12874" returned: 0 in 0.803s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d.422f679f-6a64-4bb8-9833-51afdbc12874 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:21 devstack sudo[87030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d.422f679f-6a64-4bb8-9833-51afdbc12874
Apr 02 10:29:21 devstack sudo[87030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:21 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f1a425b9-f062-4311-800c-982ae191b71a tempest-VolumesActionsTest-2043573547 None] Acquiring lock "cinder-d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a-detach_volume" by "detach_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:21 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f1a425b9-f062-4311-800c-982ae191b71a tempest-VolumesActionsTest-2043573547 None] Lock "cinder-d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:21 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-f1a425b9-f062-4311-800c-982ae191b71a tempest-VolumesActionsTest-2043573547 None] Detaching volume d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a from instance 73f4aa04-ffad-4941-85a9-d61cf641468f.
Apr 02 10:29:21 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-f1a425b9-f062-4311-800c-982ae191b71a tempest-VolumesActionsTest-2043573547 None] Detach volume completed successfully.
Apr 02 10:29:21 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f1a425b9-f062-4311-800c-982ae191b71a tempest-VolumesActionsTest-2043573547 None] Lock "cinder-d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a-detach_volume" released by "detach_volume" :: held 0.114s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:21 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-afd40cc9-be07-4814-b4b2-bbb83cb1f0ee tempest-CreateVolumesFromImageTest-77586842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:29:21 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-afd40cc9-be07-4814-b4b2-bbb83cb1f0ee tempest-CreateVolumesFromImageTest-77586842 None] Flow 'volume_create_manager' (cc073cd6-9805-4444-97da-4bedbd5ad4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:21 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-afd40cc9-be07-4814-b4b2-bbb83cb1f0ee tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3898bc7a-7491-42bb-a86f-440eb416d708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:21 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-afd40cc9-be07-4814-b4b2-bbb83cb1f0ee tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3898bc7a-7491-42bb-a86f-440eb416d708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-15253524',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6658969-3360-4db9-ad43-20b5595e34df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5b10fe73db84581954d5680136cb5dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:22Z,use_quota=True,user_id='37997cc3a96f4dbd9aa18b882823d040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:21 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-afd40cc9-be07-4814-b4b2-bbb83cb1f0ee tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c2915b-ddc4-4707-b39d-5d099f253f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:21 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-afd40cc9-be07-4814-b4b2-bbb83cb1f0ee tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c2915b-ddc4-4707-b39d-5d099f253f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:21 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-afd40cc9-be07-4814-b4b2-bbb83cb1f0ee tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da1895a0-e0c6-47dc-85b8-edeb1e4643a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:21 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-afd40cc9-be07-4814-b4b2-bbb83cb1f0ee tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da1895a0-e0c6-47dc-85b8-edeb1e4643a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6658969-3360-4db9-ad43-20b5595e34df', 'volume_name': 'volume-b6658969-3360-4db9-ad43-20b5595e34df', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:21 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-afd40cc9-be07-4814-b4b2-bbb83cb1f0ee tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e17fa3-d8d1-4ff8-b753-e0038ddbedd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:21 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-afd40cc9-be07-4814-b4b2-bbb83cb1f0ee tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e17fa3-d8d1-4ff8-b753-e0038ddbedd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:21 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-afd40cc9-be07-4814-b4b2-bbb83cb1f0ee tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faaa12df-327e-49e5-b457-a0c01f35575e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:21 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-afd40cc9-be07-4814-b4b2-bbb83cb1f0ee tempest-CreateVolumesFromImageTest-77586842 None] Volume b6658969-3360-4db9-ad43-20b5595e34df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6658969-3360-4db9-ad43-20b5595e34df', 'volume_size': 1}
Apr 02 10:29:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-afd40cc9-be07-4814-b4b2-bbb83cb1f0ee tempest-CreateVolumesFromImageTest-77586842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-afd40cc9-be07-4814-b4b2-bbb83cb1f0ee tempest-CreateVolumesFromImageTest-77586842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:21 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-afd40cc9-be07-4814-b4b2-bbb83cb1f0ee tempest-CreateVolumesFromImageTest-77586842 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-15253524',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6658969-3360-4db9-ad43-20b5595e34df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5b10fe73db84581954d5680136cb5dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:22Z,use_quota=True,user_id='37997cc3a96f4dbd9aa18b882823d040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:29:21 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-afd40cc9-be07-4814-b4b2-bbb83cb1f0ee tempest-CreateVolumesFromImageTest-77586842 None] Creating volume b6658969-3360-4db9-ad43-20b5595e34df {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:29:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-afd40cc9-be07-4814-b4b2-bbb83cb1f0ee tempest-CreateVolumesFromImageTest-77586842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-afd40cc9-be07-4814-b4b2-bbb83cb1f0ee tempest-CreateVolumesFromImageTest-77586842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:21 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-afd40cc9-be07-4814-b4b2-bbb83cb1f0ee tempest-CreateVolumesFromImageTest-77586842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:21 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-afd40cc9-be07-4814-b4b2-bbb83cb1f0ee tempest-CreateVolumesFromImageTest-77586842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-afd40cc9-be07-4814-b4b2-bbb83cb1f0ee tempest-CreateVolumesFromImageTest-77586842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:21 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-afd40cc9-be07-4814-b4b2-bbb83cb1f0ee tempest-CreateVolumesFromImageTest-77586842 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:29:21 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-afd40cc9-be07-4814-b4b2-bbb83cb1f0ee tempest-CreateVolumesFromImageTest-77586842 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:29:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-afd40cc9-be07-4814-b4b2-bbb83cb1f0ee tempest-CreateVolumesFromImageTest-77586842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b6658969-3360-4db9-ad43-20b5595e34df 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:21 devstack sudo[87033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b6658969-3360-4db9-ad43-20b5595e34df 1073741824
Apr 02 10:29:21 devstack sudo[87033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:22 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-dcba15f9-6a7a-4aa4-9d8b-503e2d24bb92 tempest-VolumesActionsTest-1099538795 None] Acquiring lock "cinder-d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a-detach_volume" by "detach_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:22 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-dcba15f9-6a7a-4aa4-9d8b-503e2d24bb92 tempest-VolumesActionsTest-1099538795 None] Lock "cinder-d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:22 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-dcba15f9-6a7a-4aa4-9d8b-503e2d24bb92 tempest-VolumesActionsTest-1099538795 None] Volume detach called, but volume not attached.
Apr 02 10:29:22 devstack sudo[87030]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d.422f679f-6a64-4bb8-9833-51afdbc12874" returned: 0 in 0.840s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:22 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] Lock "cinder-quobyte-422f679f-6a64-4bb8-9833-51afdbc12874" released by "_delete_snapshot" :: held 3.038s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:22 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-dcba15f9-6a7a-4aa4-9d8b-503e2d24bb92 tempest-VolumesActionsTest-1099538795 None] Lock "cinder-d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a-detach_volume" released by "detach_volume" :: held 0.107s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:22 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] Lock "cinder-quobyte-f9fb7d59-a6df-4105-9826-6bfca4c2784d" released by "delete_snapshot" :: held 3.063s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:22 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e83d17f-25f2-40e8-9af2-2b3b011ed567 tempest-CreateVolumesFromImageTest-77586842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:29:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5e83d17f-25f2-40e8-9af2-2b3b011ed567 tempest-CreateVolumesFromImageTest-77586842 None] Flow 'volume_create_manager' (6fafc2e3-8944-4bc8-b305-1190adb81916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5e83d17f-25f2-40e8-9af2-2b3b011ed567 tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ffef5e2-da4d-4909-99b3-44b614f44bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5e83d17f-25f2-40e8-9af2-2b3b011ed567 tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ffef5e2-da4d-4909-99b3-44b614f44bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1002387792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcc0c23f-789e-4f00-9c30-e85c928accb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5b10fe73db84581954d5680136cb5dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:22Z,use_quota=True,user_id='37997cc3a96f4dbd9aa18b882823d040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5e83d17f-25f2-40e8-9af2-2b3b011ed567 tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebe7fcb1-c6d1-4408-97f6-0cad444d5bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5e83d17f-25f2-40e8-9af2-2b3b011ed567 tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebe7fcb1-c6d1-4408-97f6-0cad444d5bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5e83d17f-25f2-40e8-9af2-2b3b011ed567 tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9883ae60-e3fb-4dc7-9264-03b3fed296e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5e83d17f-25f2-40e8-9af2-2b3b011ed567 tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9883ae60-e3fb-4dc7-9264-03b3fed296e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcc0c23f-789e-4f00-9c30-e85c928accb0', 'volume_name': 'volume-dcc0c23f-789e-4f00-9c30-e85c928accb0', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5e83d17f-25f2-40e8-9af2-2b3b011ed567 tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51b2c6fb-2a49-49bd-b917-656816081ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5e83d17f-25f2-40e8-9af2-2b3b011ed567 tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51b2c6fb-2a49-49bd-b917-656816081ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5e83d17f-25f2-40e8-9af2-2b3b011ed567 tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b8a640-4059-443e-b6fd-236ee81b2d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:22 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-5e83d17f-25f2-40e8-9af2-2b3b011ed567 tempest-CreateVolumesFromImageTest-77586842 None] Volume dcc0c23f-789e-4f00-9c30-e85c928accb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcc0c23f-789e-4f00-9c30-e85c928accb0', 'volume_size': 1}
Apr 02 10:29:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5e83d17f-25f2-40e8-9af2-2b3b011ed567 tempest-CreateVolumesFromImageTest-77586842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:22 devstack cinder-volume[82102]: WARNING cinder.quota [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-441872693 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-441872693, it is now deprecated. Please use the default quota class for default quota.
Apr 02 10:29:22 devstack cinder-volume[82102]: WARNING cinder.quota [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-441872693 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-441872693, it is now deprecated. Please use the default quota class for default quota.
Apr 02 10:29:22 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] Created reservations ['aba435bd-fdda-42f6-98b3-699710c91770', '171e4027-e49c-4d52-94ef-a4cbd4775a7e', '95e042e8-583a-4abd-8a39-4f1895bba648', 'b7ced919-336e-4339-87e4-050b06fb006d'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:29:22 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfd6f620-e6e7-46c0-ab45-45fbd96a5934 tempest-CreateVolumesFromImageTest-77586842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:29:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bfd6f620-e6e7-46c0-ab45-45fbd96a5934 tempest-CreateVolumesFromImageTest-77586842 None] Flow 'volume_create_manager' (24e59b88-457b-4e5f-b37c-a82119b5fb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bfd6f620-e6e7-46c0-ab45-45fbd96a5934 tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a604e3f3-e84f-4da4-a7a2-9a66d40dee9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bfd6f620-e6e7-46c0-ab45-45fbd96a5934 tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a604e3f3-e84f-4da4-a7a2-9a66d40dee9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1067385049',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7899bcea-3583-42df-bfd2-2592a437302a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5b10fe73db84581954d5680136cb5dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:23Z,use_quota=True,user_id='37997cc3a96f4dbd9aa18b882823d040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bfd6f620-e6e7-46c0-ab45-45fbd96a5934 tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b690669f-4037-403e-8b7a-6f221de406c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bfd6f620-e6e7-46c0-ab45-45fbd96a5934 tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b690669f-4037-403e-8b7a-6f221de406c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bfd6f620-e6e7-46c0-ab45-45fbd96a5934 tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c242e53b-2330-4eeb-a056-455891511bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bfd6f620-e6e7-46c0-ab45-45fbd96a5934 tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c242e53b-2330-4eeb-a056-455891511bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7899bcea-3583-42df-bfd2-2592a437302a', 'volume_name': 'volume-7899bcea-3583-42df-bfd2-2592a437302a', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bfd6f620-e6e7-46c0-ab45-45fbd96a5934 tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9477d8-67b6-4008-bf5c-f9a06b60f3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bfd6f620-e6e7-46c0-ab45-45fbd96a5934 tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9477d8-67b6-4008-bf5c-f9a06b60f3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bfd6f620-e6e7-46c0-ab45-45fbd96a5934 tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d555c66a-5da9-47dd-955a-1f267b7f3de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:22 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-bfd6f620-e6e7-46c0-ab45-45fbd96a5934 tempest-CreateVolumesFromImageTest-77586842 None] Volume 7899bcea-3583-42df-bfd2-2592a437302a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7899bcea-3583-42df-bfd2-2592a437302a', 'volume_size': 1}
Apr 02 10:29:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bfd6f620-e6e7-46c0-ab45-45fbd96a5934 tempest-CreateVolumesFromImageTest-77586842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:22 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a8ba870d-9266-4e1a-aa01-1530cda3a1c2 tempest-VolumesActionsTest-1099538795 None] Acquiring lock "cinder-d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:22 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] Created reservations ['5471aa1d-b022-4588-9df9-5f883e604352', 'a45229ac-a609-4cfc-81ce-585a2045c740', 'd0e0e327-ef7f-42d7-88ae-8faa8e1a0d09', '45637026-f77e-464b-b017-d8860ffb7953'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:29:22 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a8ba870d-9266-4e1a-aa01-1530cda3a1c2 tempest-VolumesActionsTest-1099538795 None] Lock "cinder-d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:22 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a8ba870d-9266-4e1a-aa01-1530cda3a1c2 tempest-VolumesActionsTest-1099538795 None] Acquiring lock "cinder-quobyte-d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:22 devstack sudo[87033]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:22 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a8ba870d-9266-4e1a-aa01-1530cda3a1c2 tempest-VolumesActionsTest-1099538795 None] Lock "cinder-quobyte-d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a" acquired by "delete_volume" :: waited 0.042s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-afd40cc9-be07-4814-b4b2-bbb83cb1f0ee tempest-CreateVolumesFromImageTest-77586842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b6658969-3360-4db9-ad43-20b5595e34df 1073741824" returned: 0 in 1.083s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[060bcf42-81e2-4b4d-887f-14d9b858adb4]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a8ba870d-9266-4e1a-aa01-1530cda3a1c2 tempest-VolumesActionsTest-1099538795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:23 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-c2cfdd84-0f44-45cb-94f7-2307957eeefd tempest-GroupSnapshotsTest-773077248 None] group_snapshot d1c36679-ddef-430e-9fdd-93772875a481: deleted successfully
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-afd40cc9-be07-4814-b4b2-bbb83cb1f0ee tempest-CreateVolumesFromImageTest-77586842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b6658969-3360-4db9-ad43-20b5595e34df {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:23 devstack sudo[87040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b6658969-3360-4db9-ad43-20b5595e34df
Apr 02 10:29:23 devstack sudo[87040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-adb2f1b7-98c7-49e4-9fb2-788373207c53 tempest-CreateVolumesFromImageTest-77586842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-adb2f1b7-98c7-49e4-9fb2-788373207c53 tempest-CreateVolumesFromImageTest-77586842 None] Flow 'volume_create_manager' (fff3d779-4f5a-4e07-b08a-552b92a1022e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-adb2f1b7-98c7-49e4-9fb2-788373207c53 tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab2130f3-11ac-4f82-bb64-c2f0d6c7adf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:23 devstack sudo[87038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a
Apr 02 10:29:23 devstack sudo[87038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-adb2f1b7-98c7-49e4-9fb2-788373207c53 tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab2130f3-11ac-4f82-bb64-c2f0d6c7adf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-14203365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97596bd1-9f04-4932-8b03-bd7308fd9cb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5b10fe73db84581954d5680136cb5dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:23Z,use_quota=True,user_id='37997cc3a96f4dbd9aa18b882823d040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-adb2f1b7-98c7-49e4-9fb2-788373207c53 tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (775bfd44-faa7-42f2-b079-7fc6396a14cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-adb2f1b7-98c7-49e4-9fb2-788373207c53 tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (775bfd44-faa7-42f2-b079-7fc6396a14cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-adb2f1b7-98c7-49e4-9fb2-788373207c53 tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c7635d0-b0ac-4df7-a0d0-ac7db043c222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-adb2f1b7-98c7-49e4-9fb2-788373207c53 tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c7635d0-b0ac-4df7-a0d0-ac7db043c222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97596bd1-9f04-4932-8b03-bd7308fd9cb7', 'volume_name': 'volume-97596bd1-9f04-4932-8b03-bd7308fd9cb7', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-adb2f1b7-98c7-49e4-9fb2-788373207c53 tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db07b0a9-1405-466b-b316-42dda5a513a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-adb2f1b7-98c7-49e4-9fb2-788373207c53 tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db07b0a9-1405-466b-b316-42dda5a513a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-adb2f1b7-98c7-49e4-9fb2-788373207c53 tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de365f97-0879-43a7-b87d-3b779fd941fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:23 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-adb2f1b7-98c7-49e4-9fb2-788373207c53 tempest-CreateVolumesFromImageTest-77586842 None] Volume 97596bd1-9f04-4932-8b03-bd7308fd9cb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97596bd1-9f04-4932-8b03-bd7308fd9cb7', 'volume_size': 1}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-adb2f1b7-98c7-49e4-9fb2-788373207c53 tempest-CreateVolumesFromImageTest-77586842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-9376632a-ea2f-4df4-a133-48ab853f0e1c tempest-CreateVolumesFromImageTest-77586842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9376632a-ea2f-4df4-a133-48ab853f0e1c tempest-CreateVolumesFromImageTest-77586842 None] Flow 'volume_create_manager' (4dd75ee9-56e0-43a6-b505-6282c4cb4828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9376632a-ea2f-4df4-a133-48ab853f0e1c tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a279618d-0b3b-4b2f-ad20-49091beeb3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9376632a-ea2f-4df4-a133-48ab853f0e1c tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a279618d-0b3b-4b2f-ad20-49091beeb3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-808974742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75dc10ed-5598-4722-a07f-ecd3d4ffe003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5b10fe73db84581954d5680136cb5dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:23Z,use_quota=True,user_id='37997cc3a96f4dbd9aa18b882823d040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9376632a-ea2f-4df4-a133-48ab853f0e1c tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5994333b-cb83-44c6-9fba-53dbd77238cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9376632a-ea2f-4df4-a133-48ab853f0e1c tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5994333b-cb83-44c6-9fba-53dbd77238cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9376632a-ea2f-4df4-a133-48ab853f0e1c tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cd19a47-56ae-40ed-a54c-26504eef482d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9376632a-ea2f-4df4-a133-48ab853f0e1c tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cd19a47-56ae-40ed-a54c-26504eef482d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75dc10ed-5598-4722-a07f-ecd3d4ffe003', 'volume_name': 'volume-75dc10ed-5598-4722-a07f-ecd3d4ffe003', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9376632a-ea2f-4df4-a133-48ab853f0e1c tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4488189f-e757-4e19-96fe-1e45193312e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9376632a-ea2f-4df4-a133-48ab853f0e1c tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4488189f-e757-4e19-96fe-1e45193312e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9376632a-ea2f-4df4-a133-48ab853f0e1c tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4664e42a-1448-4f9b-acef-add9f7fca073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:23 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-9376632a-ea2f-4df4-a133-48ab853f0e1c tempest-CreateVolumesFromImageTest-77586842 None] Volume 75dc10ed-5598-4722-a07f-ecd3d4ffe003: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75dc10ed-5598-4722-a07f-ecd3d4ffe003', 'volume_size': 1}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-9376632a-ea2f-4df4-a133-48ab853f0e1c tempest-CreateVolumesFromImageTest-77586842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:23 devstack sudo[87040]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-afd40cc9-be07-4814-b4b2-bbb83cb1f0ee tempest-CreateVolumesFromImageTest-77586842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b6658969-3360-4db9-ad43-20b5595e34df" returned: 0 in 0.702s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-afd40cc9-be07-4814-b4b2-bbb83cb1f0ee tempest-CreateVolumesFromImageTest-77586842 None] <== create_volume: return (1857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-afd40cc9-be07-4814-b4b2-bbb83cb1f0ee tempest-CreateVolumesFromImageTest-77586842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.863s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5e83d17f-25f2-40e8-9af2-2b3b011ed567 tempest-CreateVolumesFromImageTest-77586842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.498s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5e83d17f-25f2-40e8-9af2-2b3b011ed567 tempest-CreateVolumesFromImageTest-77586842 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1002387792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcc0c23f-789e-4f00-9c30-e85c928accb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5b10fe73db84581954d5680136cb5dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:22Z,use_quota=True,user_id='37997cc3a96f4dbd9aa18b882823d040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-5e83d17f-25f2-40e8-9af2-2b3b011ed567 tempest-CreateVolumesFromImageTest-77586842 None] Creating volume dcc0c23f-789e-4f00-9c30-e85c928accb0 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5e83d17f-25f2-40e8-9af2-2b3b011ed567 tempest-CreateVolumesFromImageTest-77586842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5e83d17f-25f2-40e8-9af2-2b3b011ed567 tempest-CreateVolumesFromImageTest-77586842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5e83d17f-25f2-40e8-9af2-2b3b011ed567 tempest-CreateVolumesFromImageTest-77586842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5e83d17f-25f2-40e8-9af2-2b3b011ed567 tempest-CreateVolumesFromImageTest-77586842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5e83d17f-25f2-40e8-9af2-2b3b011ed567 tempest-CreateVolumesFromImageTest-77586842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5e83d17f-25f2-40e8-9af2-2b3b011ed567 tempest-CreateVolumesFromImageTest-77586842 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:29:23 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-5e83d17f-25f2-40e8-9af2-2b3b011ed567 tempest-CreateVolumesFromImageTest-77586842 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5e83d17f-25f2-40e8-9af2-2b3b011ed567 tempest-CreateVolumesFromImageTest-77586842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-dcc0c23f-789e-4f00-9c30-e85c928accb0 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:23 devstack sudo[87044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-dcc0c23f-789e-4f00-9c30-e85c928accb0 1073741824
Apr 02 10:29:23 devstack sudo[87044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-afd40cc9-be07-4814-b4b2-bbb83cb1f0ee tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faaa12df-327e-49e5-b457-a0c01f35575e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6658969-3360-4db9-ad43-20b5595e34df', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-afd40cc9-be07-4814-b4b2-bbb83cb1f0ee tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ab8c4f-be0a-4852-970a-3a6e0e82370f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:23 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-afd40cc9-be07-4814-b4b2-bbb83cb1f0ee tempest-CreateVolumesFromImageTest-77586842 None] Volume volume-b6658969-3360-4db9-ad43-20b5595e34df (b6658969-3360-4db9-ad43-20b5595e34df): created successfully
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-afd40cc9-be07-4814-b4b2-bbb83cb1f0ee tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ab8c4f-be0a-4852-970a-3a6e0e82370f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-afd40cc9-be07-4814-b4b2-bbb83cb1f0ee tempest-CreateVolumesFromImageTest-77586842 None] Flow 'volume_create_manager' (cc073cd6-9805-4444-97da-4bedbd5ad4c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-31b2015a-f4dc-4622-a3b3-5d464712c33c tempest-GroupSnapshotsTest-773077248 None] Acquiring lock "cinder-quobyte-2b8c6fa7-e201-426e-a693-0d605a634a00" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-31b2015a-f4dc-4622-a3b3-5d464712c33c tempest-GroupSnapshotsTest-773077248 None] Lock "cinder-quobyte-2b8c6fa7-e201-426e-a693-0d605a634a00" acquired by "delete_volume" :: waited 0.019s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:23 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-afd40cc9-be07-4814-b4b2-bbb83cb1f0ee tempest-CreateVolumesFromImageTest-77586842 None] Created volume successfully.
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ede4f2-79df-414a-9c8c-1c5cc2cdfccc]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:29:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-31b2015a-f4dc-4622-a3b3-5d464712c33c tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:24 devstack sudo[87049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00
Apr 02 10:29:24 devstack sudo[87049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:24 devstack sudo[87038]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a8ba870d-9266-4e1a-aa01-1530cda3a1c2 tempest-VolumesActionsTest-1099538795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a" returned: 0 in 1.051s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a8ba870d-9266-4e1a-aa01-1530cda3a1c2 tempest-VolumesActionsTest-1099538795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:24 devstack sudo[87051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a
Apr 02 10:29:24 devstack sudo[87051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:24 devstack sudo[87049]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-31b2015a-f4dc-4622-a3b3-5d464712c33c tempest-GroupSnapshotsTest-773077248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00" returned: 0 in 0.767s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-31b2015a-f4dc-4622-a3b3-5d464712c33c tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:24 devstack sudo[87060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00
Apr 02 10:29:24 devstack sudo[87060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:24 devstack sudo[87044]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5e83d17f-25f2-40e8-9af2-2b3b011ed567 tempest-CreateVolumesFromImageTest-77586842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-dcc0c23f-789e-4f00-9c30-e85c928accb0 1073741824" returned: 0 in 0.962s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5e83d17f-25f2-40e8-9af2-2b3b011ed567 tempest-CreateVolumesFromImageTest-77586842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-dcc0c23f-789e-4f00-9c30-e85c928accb0 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:24 devstack sudo[87062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-dcc0c23f-789e-4f00-9c30-e85c928accb0
Apr 02 10:29:24 devstack sudo[87062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:24 devstack sudo[87051]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a8ba870d-9266-4e1a-aa01-1530cda3a1c2 tempest-VolumesActionsTest-1099538795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a" returned: 0 in 0.785s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:24 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a8ba870d-9266-4e1a-aa01-1530cda3a1c2 tempest-VolumesActionsTest-1099538795 None] Lock "cinder-quobyte-d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a" released by "delete_volume" :: held 1.884s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:24 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-a8ba870d-9266-4e1a-aa01-1530cda3a1c2 tempest-VolumesActionsTest-1099538795 None] Created reservations ['c6f3d904-8c64-4d7b-b9e5-ca151224a200', 'a97d5ea0-f4f1-4937-833d-b2663beec1a9', '0f898d57-025f-4ee7-ab3d-f89afe8a2aa9', '65ee4738-2cef-430a-be4b-bf76c4af870d'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:29:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a8ba870d-9266-4e1a-aa01-1530cda3a1c2 tempest-VolumesActionsTest-1099538795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a8ba870d-9266-4e1a-aa01-1530cda3a1c2 tempest-VolumesActionsTest-1099538795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:25 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-a8ba870d-9266-4e1a-aa01-1530cda3a1c2 tempest-VolumesActionsTest-1099538795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:25 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-a8ba870d-9266-4e1a-aa01-1530cda3a1c2 tempest-VolumesActionsTest-1099538795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a8ba870d-9266-4e1a-aa01-1530cda3a1c2 tempest-VolumesActionsTest-1099538795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a8ba870d-9266-4e1a-aa01-1530cda3a1c2 tempest-VolumesActionsTest-1099538795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:25 devstack sudo[87064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:29:25 devstack sudo[87064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:25 devstack sudo[87062]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5e83d17f-25f2-40e8-9af2-2b3b011ed567 tempest-CreateVolumesFromImageTest-77586842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-dcc0c23f-789e-4f00-9c30-e85c928accb0" returned: 0 in 0.631s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:25 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5e83d17f-25f2-40e8-9af2-2b3b011ed567 tempest-CreateVolumesFromImageTest-77586842 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:29:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5e83d17f-25f2-40e8-9af2-2b3b011ed567 tempest-CreateVolumesFromImageTest-77586842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bfd6f620-e6e7-46c0-ab45-45fbd96a5934 tempest-CreateVolumesFromImageTest-77586842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.624s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:25 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-bfd6f620-e6e7-46c0-ab45-45fbd96a5934 tempest-CreateVolumesFromImageTest-77586842 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1067385049',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7899bcea-3583-42df-bfd2-2592a437302a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5b10fe73db84581954d5680136cb5dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:23Z,use_quota=True,user_id='37997cc3a96f4dbd9aa18b882823d040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:29:25 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-bfd6f620-e6e7-46c0-ab45-45fbd96a5934 tempest-CreateVolumesFromImageTest-77586842 None] Creating volume 7899bcea-3583-42df-bfd2-2592a437302a {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:29:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bfd6f620-e6e7-46c0-ab45-45fbd96a5934 tempest-CreateVolumesFromImageTest-77586842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bfd6f620-e6e7-46c0-ab45-45fbd96a5934 tempest-CreateVolumesFromImageTest-77586842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:25 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-bfd6f620-e6e7-46c0-ab45-45fbd96a5934 tempest-CreateVolumesFromImageTest-77586842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:25 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-bfd6f620-e6e7-46c0-ab45-45fbd96a5934 tempest-CreateVolumesFromImageTest-77586842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bfd6f620-e6e7-46c0-ab45-45fbd96a5934 tempest-CreateVolumesFromImageTest-77586842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:25 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-bfd6f620-e6e7-46c0-ab45-45fbd96a5934 tempest-CreateVolumesFromImageTest-77586842 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:29:25 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-bfd6f620-e6e7-46c0-ab45-45fbd96a5934 tempest-CreateVolumesFromImageTest-77586842 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:29:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bfd6f620-e6e7-46c0-ab45-45fbd96a5934 tempest-CreateVolumesFromImageTest-77586842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-7899bcea-3583-42df-bfd2-2592a437302a 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5e83d17f-25f2-40e8-9af2-2b3b011ed567 tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b8a640-4059-443e-b6fd-236ee81b2d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcc0c23f-789e-4f00-9c30-e85c928accb0', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5e83d17f-25f2-40e8-9af2-2b3b011ed567 tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c42fe9c-0d41-4977-951a-14a3d43e3b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:25 devstack sudo[87068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-7899bcea-3583-42df-bfd2-2592a437302a 1073741824
Apr 02 10:29:25 devstack sudo[87068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:25 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-5e83d17f-25f2-40e8-9af2-2b3b011ed567 tempest-CreateVolumesFromImageTest-77586842 None] Volume volume-dcc0c23f-789e-4f00-9c30-e85c928accb0 (dcc0c23f-789e-4f00-9c30-e85c928accb0): created successfully
Apr 02 10:29:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5e83d17f-25f2-40e8-9af2-2b3b011ed567 tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c42fe9c-0d41-4977-951a-14a3d43e3b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5e83d17f-25f2-40e8-9af2-2b3b011ed567 tempest-CreateVolumesFromImageTest-77586842 None] Flow 'volume_create_manager' (6fafc2e3-8944-4bc8-b305-1190adb81916) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:25 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-5e83d17f-25f2-40e8-9af2-2b3b011ed567 tempest-CreateVolumesFromImageTest-77586842 None] Created volume successfully.
Apr 02 10:29:25 devstack sudo[87060]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-31b2015a-f4dc-4622-a3b3-5d464712c33c tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2b8c6fa7-e201-426e-a693-0d605a634a00" returned: 0 in 0.934s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:25 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-31b2015a-f4dc-4622-a3b3-5d464712c33c tempest-GroupSnapshotsTest-773077248 None] Lock "cinder-quobyte-2b8c6fa7-e201-426e-a693-0d605a634a00" released by "delete_volume" :: held 1.738s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:25 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-31b2015a-f4dc-4622-a3b3-5d464712c33c tempest-GroupSnapshotsTest-773077248 None] Acquiring lock "cinder-quobyte-f9fb7d59-a6df-4105-9826-6bfca4c2784d" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:25 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-31b2015a-f4dc-4622-a3b3-5d464712c33c tempest-GroupSnapshotsTest-773077248 None] Lock "cinder-quobyte-f9fb7d59-a6df-4105-9826-6bfca4c2784d" acquired by "delete_volume" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:25 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3accf009-3d3c-4fe6-91ef-e7061563ea9b]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:29:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-31b2015a-f4dc-4622-a3b3-5d464712c33c tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:25 devstack sudo[87070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d
Apr 02 10:29:25 devstack sudo[87070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:25 devstack sudo[87064]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a8ba870d-9266-4e1a-aa01-1530cda3a1c2 tempest-VolumesActionsTest-1099538795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.918s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:25 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-a8ba870d-9266-4e1a-aa01-1530cda3a1c2 tempest-VolumesActionsTest-1099538795 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:29:25 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-a8ba870d-9266-4e1a-aa01-1530cda3a1c2 tempest-VolumesActionsTest-1099538795 None] Deleted volume successfully.
Apr 02 10:29:26 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a8ba870d-9266-4e1a-aa01-1530cda3a1c2 tempest-VolumesActionsTest-1099538795 None] Lock "cinder-d3a6908e-fadf-4c70-b27c-0fb14a4b6a0a-delete_volume" released by "delete_volume" :: held 3.113s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:26 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a131640-6557-4dad-bf94-7fc791904a53 tempest-VolumesCloneNegativeTest-728148717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:29:26 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5a131640-6557-4dad-bf94-7fc791904a53 tempest-VolumesCloneNegativeTest-728148717 None] Flow 'volume_create_manager' (4a0d4c17-8a82-4595-8629-6bef7d053698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:26 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5a131640-6557-4dad-bf94-7fc791904a53 tempest-VolumesCloneNegativeTest-728148717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b1437fb-e221-4924-bc79-3e36c067d4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:26 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5a131640-6557-4dad-bf94-7fc791904a53 tempest-VolumesCloneNegativeTest-728148717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b1437fb-e221-4924-bc79-3e36c067d4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1018586591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41391920-e263-4dd1-8e79-16807f7eca78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aacdedd33f69442d9d3ed0f9f3641041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:26Z,use_quota=True,user_id='724c349272f840e6998011d3907d216c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:26 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5a131640-6557-4dad-bf94-7fc791904a53 tempest-VolumesCloneNegativeTest-728148717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b60d4540-ae99-434f-9d96-094e9db60021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:26 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5a131640-6557-4dad-bf94-7fc791904a53 tempest-VolumesCloneNegativeTest-728148717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b60d4540-ae99-434f-9d96-094e9db60021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:26 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5a131640-6557-4dad-bf94-7fc791904a53 tempest-VolumesCloneNegativeTest-728148717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b3976f-59d5-4faa-be35-6e323ede2cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:26 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5a131640-6557-4dad-bf94-7fc791904a53 tempest-VolumesCloneNegativeTest-728148717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b3976f-59d5-4faa-be35-6e323ede2cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41391920-e263-4dd1-8e79-16807f7eca78', 'volume_name': 'volume-41391920-e263-4dd1-8e79-16807f7eca78', 'volume_size': 2}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:26 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5a131640-6557-4dad-bf94-7fc791904a53 tempest-VolumesCloneNegativeTest-728148717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (294b9b29-f58e-4a07-9808-7f6a42910073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:26 devstack sudo[87068]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:26 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5a131640-6557-4dad-bf94-7fc791904a53 tempest-VolumesCloneNegativeTest-728148717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (294b9b29-f58e-4a07-9808-7f6a42910073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:26 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5a131640-6557-4dad-bf94-7fc791904a53 tempest-VolumesCloneNegativeTest-728148717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20578774-4cb3-431d-9444-0c9c50c9cbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:26 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-5a131640-6557-4dad-bf94-7fc791904a53 tempest-VolumesCloneNegativeTest-728148717 None] Volume 41391920-e263-4dd1-8e79-16807f7eca78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41391920-e263-4dd1-8e79-16807f7eca78', 'volume_size': 2}
Apr 02 10:29:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5a131640-6557-4dad-bf94-7fc791904a53 tempest-VolumesCloneNegativeTest-728148717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bfd6f620-e6e7-46c0-ab45-45fbd96a5934 tempest-CreateVolumesFromImageTest-77586842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-7899bcea-3583-42df-bfd2-2592a437302a 1073741824" returned: 0 in 0.917s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:26 devstack sudo[87070]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-31b2015a-f4dc-4622-a3b3-5d464712c33c tempest-GroupSnapshotsTest-773077248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d" returned: 0 in 0.656s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-31b2015a-f4dc-4622-a3b3-5d464712c33c tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:26 devstack sudo[87087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d
Apr 02 10:29:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bfd6f620-e6e7-46c0-ab45-45fbd96a5934 tempest-CreateVolumesFromImageTest-77586842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-7899bcea-3583-42df-bfd2-2592a437302a {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:26 devstack sudo[87087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:26 devstack sudo[87090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-7899bcea-3583-42df-bfd2-2592a437302a
Apr 02 10:29:26 devstack sudo[87090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:26 devstack sudo[87087]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-31b2015a-f4dc-4622-a3b3-5d464712c33c tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f9fb7d59-a6df-4105-9826-6bfca4c2784d" returned: 0 in 0.533s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:26 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-31b2015a-f4dc-4622-a3b3-5d464712c33c tempest-GroupSnapshotsTest-773077248 None] Lock "cinder-quobyte-f9fb7d59-a6df-4105-9826-6bfca4c2784d" released by "delete_volume" :: held 1.227s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:26 devstack sudo[87090]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bfd6f620-e6e7-46c0-ab45-45fbd96a5934 tempest-CreateVolumesFromImageTest-77586842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-7899bcea-3583-42df-bfd2-2592a437302a" returned: 0 in 0.553s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:26 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-bfd6f620-e6e7-46c0-ab45-45fbd96a5934 tempest-CreateVolumesFromImageTest-77586842 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:29:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bfd6f620-e6e7-46c0-ab45-45fbd96a5934 tempest-CreateVolumesFromImageTest-77586842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-adb2f1b7-98c7-49e4-9fb2-788373207c53 tempest-CreateVolumesFromImageTest-77586842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.608s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:26 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-adb2f1b7-98c7-49e4-9fb2-788373207c53 tempest-CreateVolumesFromImageTest-77586842 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-14203365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97596bd1-9f04-4932-8b03-bd7308fd9cb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5b10fe73db84581954d5680136cb5dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:23Z,use_quota=True,user_id='37997cc3a96f4dbd9aa18b882823d040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:29:26 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-adb2f1b7-98c7-49e4-9fb2-788373207c53 tempest-CreateVolumesFromImageTest-77586842 None] Creating volume 97596bd1-9f04-4932-8b03-bd7308fd9cb7 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:29:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-adb2f1b7-98c7-49e4-9fb2-788373207c53 tempest-CreateVolumesFromImageTest-77586842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-adb2f1b7-98c7-49e4-9fb2-788373207c53 tempest-CreateVolumesFromImageTest-77586842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:26 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-adb2f1b7-98c7-49e4-9fb2-788373207c53 tempest-CreateVolumesFromImageTest-77586842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:26 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-adb2f1b7-98c7-49e4-9fb2-788373207c53 tempest-CreateVolumesFromImageTest-77586842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-adb2f1b7-98c7-49e4-9fb2-788373207c53 tempest-CreateVolumesFromImageTest-77586842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:26 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-adb2f1b7-98c7-49e4-9fb2-788373207c53 tempest-CreateVolumesFromImageTest-77586842 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:29:26 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-adb2f1b7-98c7-49e4-9fb2-788373207c53 tempest-CreateVolumesFromImageTest-77586842 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:29:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-adb2f1b7-98c7-49e4-9fb2-788373207c53 tempest-CreateVolumesFromImageTest-77586842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-97596bd1-9f04-4932-8b03-bd7308fd9cb7 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:27 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bfd6f620-e6e7-46c0-ab45-45fbd96a5934 tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d555c66a-5da9-47dd-955a-1f267b7f3de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7899bcea-3583-42df-bfd2-2592a437302a', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:27 devstack sudo[87109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-97596bd1-9f04-4932-8b03-bd7308fd9cb7 1073741824
Apr 02 10:29:27 devstack sudo[87109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:27 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bfd6f620-e6e7-46c0-ab45-45fbd96a5934 tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f0d88a2-5230-45c4-b0c5-7d5a3e0322dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:27 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-bfd6f620-e6e7-46c0-ab45-45fbd96a5934 tempest-CreateVolumesFromImageTest-77586842 None] Volume volume-7899bcea-3583-42df-bfd2-2592a437302a (7899bcea-3583-42df-bfd2-2592a437302a): created successfully
Apr 02 10:29:27 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bfd6f620-e6e7-46c0-ab45-45fbd96a5934 tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f0d88a2-5230-45c4-b0c5-7d5a3e0322dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:27 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bfd6f620-e6e7-46c0-ab45-45fbd96a5934 tempest-CreateVolumesFromImageTest-77586842 None] Flow 'volume_create_manager' (24e59b88-457b-4e5f-b37c-a82119b5fb1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:27 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-bfd6f620-e6e7-46c0-ab45-45fbd96a5934 tempest-CreateVolumesFromImageTest-77586842 None] Created volume successfully.
Apr 02 10:29:27 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-31b2015a-f4dc-4622-a3b3-5d464712c33c tempest-GroupSnapshotsTest-773077248 None] Created reservations ['f20af1ab-c56e-4de5-8b2e-c6a88bc9ba0e'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:29:27 devstack cinder-volume[82102]: WARNING cinder.quota [None req-31b2015a-f4dc-4622-a3b3-5d464712c33c tempest-GroupSnapshotsTest-773077248 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-441872693 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-441872693, it is now deprecated. Please use the default quota class for default quota.
Apr 02 10:29:27 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-31b2015a-f4dc-4622-a3b3-5d464712c33c tempest-GroupSnapshotsTest-773077248 None] Created reservations ['f155b48a-e929-40e4-bde3-79967fafd8d7', '580cf20c-c49e-4a7e-8da2-90781ed9e43e', 'dfc68a50-2c3d-4fcd-a2ff-1d3a060dc24d', '520c0075-0136-46af-af37-cb41a5cbbffc'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:29:27 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-31b2015a-f4dc-4622-a3b3-5d464712c33c tempest-GroupSnapshotsTest-773077248 None] Created reservations ['383d821a-22ce-4ddd-a731-9689f260af6e', '2258969a-2e1e-43d0-9ca5-bd75c3ff301f', '1bf9a531-cb09-4c27-b40a-777cecba08ed', '79260712-a846-44fd-89e8-e480be1178d6'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:29:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-31b2015a-f4dc-4622-a3b3-5d464712c33c tempest-GroupSnapshotsTest-773077248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-31b2015a-f4dc-4622-a3b3-5d464712c33c tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:27 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-31b2015a-f4dc-4622-a3b3-5d464712c33c tempest-GroupSnapshotsTest-773077248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:27 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-31b2015a-f4dc-4622-a3b3-5d464712c33c tempest-GroupSnapshotsTest-773077248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-31b2015a-f4dc-4622-a3b3-5d464712c33c tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-31b2015a-f4dc-4622-a3b3-5d464712c33c tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:27 devstack sudo[87111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:29:27 devstack sudo[87111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:27 devstack sudo[87109]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-adb2f1b7-98c7-49e4-9fb2-788373207c53 tempest-CreateVolumesFromImageTest-77586842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-97596bd1-9f04-4932-8b03-bd7308fd9cb7 1073741824" returned: 0 in 0.521s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-adb2f1b7-98c7-49e4-9fb2-788373207c53 tempest-CreateVolumesFromImageTest-77586842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-97596bd1-9f04-4932-8b03-bd7308fd9cb7 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:27 devstack sudo[87116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-97596bd1-9f04-4932-8b03-bd7308fd9cb7
Apr 02 10:29:27 devstack sudo[87116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:27 devstack sudo[87111]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-31b2015a-f4dc-4622-a3b3-5d464712c33c tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.448s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:27 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-31b2015a-f4dc-4622-a3b3-5d464712c33c tempest-GroupSnapshotsTest-773077248 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:29:27 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-31b2015a-f4dc-4622-a3b3-5d464712c33c tempest-GroupSnapshotsTest-773077248 None] Delete group completed successfully.
Apr 02 10:29:27 devstack sudo[87116]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-adb2f1b7-98c7-49e4-9fb2-788373207c53 tempest-CreateVolumesFromImageTest-77586842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-97596bd1-9f04-4932-8b03-bd7308fd9cb7" returned: 0 in 0.453s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:27 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-adb2f1b7-98c7-49e4-9fb2-788373207c53 tempest-CreateVolumesFromImageTest-77586842 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:29:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-adb2f1b7-98c7-49e4-9fb2-788373207c53 tempest-CreateVolumesFromImageTest-77586842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-9376632a-ea2f-4df4-a133-48ab853f0e1c tempest-CreateVolumesFromImageTest-77586842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.465s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:27 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-9376632a-ea2f-4df4-a133-48ab853f0e1c tempest-CreateVolumesFromImageTest-77586842 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-808974742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75dc10ed-5598-4722-a07f-ecd3d4ffe003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5b10fe73db84581954d5680136cb5dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:23Z,use_quota=True,user_id='37997cc3a96f4dbd9aa18b882823d040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:29:27 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-9376632a-ea2f-4df4-a133-48ab853f0e1c tempest-CreateVolumesFromImageTest-77586842 None] Creating volume 75dc10ed-5598-4722-a07f-ecd3d4ffe003 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:29:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-9376632a-ea2f-4df4-a133-48ab853f0e1c tempest-CreateVolumesFromImageTest-77586842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-9376632a-ea2f-4df4-a133-48ab853f0e1c tempest-CreateVolumesFromImageTest-77586842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:27 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-9376632a-ea2f-4df4-a133-48ab853f0e1c tempest-CreateVolumesFromImageTest-77586842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:27 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-9376632a-ea2f-4df4-a133-48ab853f0e1c tempest-CreateVolumesFromImageTest-77586842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-9376632a-ea2f-4df4-a133-48ab853f0e1c tempest-CreateVolumesFromImageTest-77586842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:27 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-9376632a-ea2f-4df4-a133-48ab853f0e1c tempest-CreateVolumesFromImageTest-77586842 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:29:27 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-9376632a-ea2f-4df4-a133-48ab853f0e1c tempest-CreateVolumesFromImageTest-77586842 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:29:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9376632a-ea2f-4df4-a133-48ab853f0e1c tempest-CreateVolumesFromImageTest-77586842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-75dc10ed-5598-4722-a07f-ecd3d4ffe003 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:28 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-adb2f1b7-98c7-49e4-9fb2-788373207c53 tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de365f97-0879-43a7-b87d-3b779fd941fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97596bd1-9f04-4932-8b03-bd7308fd9cb7', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:28 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-adb2f1b7-98c7-49e4-9fb2-788373207c53 tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b79556-94e6-4114-8e84-d9fcf2161442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:28 devstack sudo[87121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-75dc10ed-5598-4722-a07f-ecd3d4ffe003 1073741824
Apr 02 10:29:28 devstack sudo[87121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:28 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-adb2f1b7-98c7-49e4-9fb2-788373207c53 tempest-CreateVolumesFromImageTest-77586842 None] Volume volume-97596bd1-9f04-4932-8b03-bd7308fd9cb7 (97596bd1-9f04-4932-8b03-bd7308fd9cb7): created successfully
Apr 02 10:29:28 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-adb2f1b7-98c7-49e4-9fb2-788373207c53 tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b79556-94e6-4114-8e84-d9fcf2161442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:28 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-adb2f1b7-98c7-49e4-9fb2-788373207c53 tempest-CreateVolumesFromImageTest-77586842 None] Flow 'volume_create_manager' (fff3d779-4f5a-4e07-b08a-552b92a1022e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:28 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-adb2f1b7-98c7-49e4-9fb2-788373207c53 tempest-CreateVolumesFromImageTest-77586842 None] Created volume successfully.
Apr 02 10:29:28 devstack sudo[87121]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9376632a-ea2f-4df4-a133-48ab853f0e1c tempest-CreateVolumesFromImageTest-77586842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-75dc10ed-5598-4722-a07f-ecd3d4ffe003 1073741824" returned: 0 in 0.573s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:28 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-db99905d-e875-43da-a54c-1095327f0c33 tempest-GroupSnapshotsTest-773077248 None] Group tempest-GroupSnapshotsTest-Group-522699356: creating
Apr 02 10:29:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9376632a-ea2f-4df4-a133-48ab853f0e1c tempest-CreateVolumesFromImageTest-77586842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-75dc10ed-5598-4722-a07f-ecd3d4ffe003 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:28 devstack sudo[87126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-75dc10ed-5598-4722-a07f-ecd3d4ffe003
Apr 02 10:29:28 devstack sudo[87126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:28 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-db99905d-e875-43da-a54c-1095327f0c33 tempest-GroupSnapshotsTest-773077248 None] Group tempest-GroupSnapshotsTest-Group-522699356: created successfully
Apr 02 10:29:28 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-db99905d-e875-43da-a54c-1095327f0c33 tempest-GroupSnapshotsTest-773077248 None] Create group completed successfully.
Apr 02 10:29:29 devstack sudo[87126]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9376632a-ea2f-4df4-a133-48ab853f0e1c tempest-CreateVolumesFromImageTest-77586842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-75dc10ed-5598-4722-a07f-ecd3d4ffe003" returned: 0 in 0.446s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:29 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-9376632a-ea2f-4df4-a133-48ab853f0e1c tempest-CreateVolumesFromImageTest-77586842 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:29:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-9376632a-ea2f-4df4-a133-48ab853f0e1c tempest-CreateVolumesFromImageTest-77586842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5a131640-6557-4dad-bf94-7fc791904a53 tempest-VolumesCloneNegativeTest-728148717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.674s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:29 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5a131640-6557-4dad-bf94-7fc791904a53 tempest-VolumesCloneNegativeTest-728148717 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1018586591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41391920-e263-4dd1-8e79-16807f7eca78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aacdedd33f69442d9d3ed0f9f3641041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:26Z,use_quota=True,user_id='724c349272f840e6998011d3907d216c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:29:29 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-5a131640-6557-4dad-bf94-7fc791904a53 tempest-VolumesCloneNegativeTest-728148717 None] Creating volume 41391920-e263-4dd1-8e79-16807f7eca78 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:29:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5a131640-6557-4dad-bf94-7fc791904a53 tempest-VolumesCloneNegativeTest-728148717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5a131640-6557-4dad-bf94-7fc791904a53 tempest-VolumesCloneNegativeTest-728148717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:29 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5a131640-6557-4dad-bf94-7fc791904a53 tempest-VolumesCloneNegativeTest-728148717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:29 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5a131640-6557-4dad-bf94-7fc791904a53 tempest-VolumesCloneNegativeTest-728148717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5a131640-6557-4dad-bf94-7fc791904a53 tempest-VolumesCloneNegativeTest-728148717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:29 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5a131640-6557-4dad-bf94-7fc791904a53 tempest-VolumesCloneNegativeTest-728148717 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:29:29 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-5a131640-6557-4dad-bf94-7fc791904a53 tempest-VolumesCloneNegativeTest-728148717 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:29:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5a131640-6557-4dad-bf94-7fc791904a53 tempest-VolumesCloneNegativeTest-728148717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41391920-e263-4dd1-8e79-16807f7eca78 2147483648 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:29 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9376632a-ea2f-4df4-a133-48ab853f0e1c tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4664e42a-1448-4f9b-acef-add9f7fca073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75dc10ed-5598-4722-a07f-ecd3d4ffe003', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:29 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9376632a-ea2f-4df4-a133-48ab853f0e1c tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3729c54f-d375-462a-bee3-dab341d27683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:29 devstack sudo[87131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41391920-e263-4dd1-8e79-16807f7eca78 2147483648
Apr 02 10:29:29 devstack sudo[87131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:29 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-9376632a-ea2f-4df4-a133-48ab853f0e1c tempest-CreateVolumesFromImageTest-77586842 None] Volume volume-75dc10ed-5598-4722-a07f-ecd3d4ffe003 (75dc10ed-5598-4722-a07f-ecd3d4ffe003): created successfully
Apr 02 10:29:29 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9376632a-ea2f-4df4-a133-48ab853f0e1c tempest-CreateVolumesFromImageTest-77586842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3729c54f-d375-462a-bee3-dab341d27683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:29 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9376632a-ea2f-4df4-a133-48ab853f0e1c tempest-CreateVolumesFromImageTest-77586842 None] Flow 'volume_create_manager' (4dd75ee9-56e0-43a6-b505-6282c4cb4828) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:29 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-9376632a-ea2f-4df4-a133-48ab853f0e1c tempest-CreateVolumesFromImageTest-77586842 None] Created volume successfully.
Apr 02 10:29:29 devstack sudo[87131]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5a131640-6557-4dad-bf94-7fc791904a53 tempest-VolumesCloneNegativeTest-728148717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41391920-e263-4dd1-8e79-16807f7eca78 2147483648" returned: 0 in 0.565s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5a131640-6557-4dad-bf94-7fc791904a53 tempest-VolumesCloneNegativeTest-728148717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41391920-e263-4dd1-8e79-16807f7eca78 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:29 devstack sudo[87136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41391920-e263-4dd1-8e79-16807f7eca78
Apr 02 10:29:29 devstack sudo[87136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:29 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-13652fd8-6788-4111-8e17-d8f210d958e6 tempest-GroupSnapshotsTest-773077248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:29:29 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-13652fd8-6788-4111-8e17-d8f210d958e6 tempest-GroupSnapshotsTest-773077248 None] Flow 'volume_create_manager' (5e4128d9-49a1-47cc-b7ee-7bb419447976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:29 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-13652fd8-6788-4111-8e17-d8f210d958e6 tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc41969-89cb-4d9a-8e46-61ab25f559e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:29 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-13652fd8-6788-4111-8e17-d8f210d958e6 tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc41969-89cb-4d9a-8e46-61ab25f559e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-106900284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f250d342-3790-4d7d-a858-56e0de0f5425,host='devstack@QuobyteHD#QuobyteHD',id=b1784ccc-d470-4bb2-b340-5ffc2187c97a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='715df5a8413948c3abcecf488c7f9810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:30Z,use_quota=True,user_id='59fae1ac304a413883534cd7e39c3820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59555be5-e02e-451c-bddd-d7ca0b565d7a),volume_type_id=59555be5-e02e-451c-bddd-d7ca0b565d7a)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:29 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-13652fd8-6788-4111-8e17-d8f210d958e6 tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8bf7a3a-2094-4e9d-ad11-9e3cdf53e1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:29 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-13652fd8-6788-4111-8e17-d8f210d958e6 tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8bf7a3a-2094-4e9d-ad11-9e3cdf53e1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:29 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-13652fd8-6788-4111-8e17-d8f210d958e6 tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a569177-af19-4aa0-a4fd-6827f01bd180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:29 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-13652fd8-6788-4111-8e17-d8f210d958e6 tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a569177-af19-4aa0-a4fd-6827f01bd180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1784ccc-d470-4bb2-b340-5ffc2187c97a', 'volume_name': 'volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-13652fd8-6788-4111-8e17-d8f210d958e6 tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7aa702-4ecc-4a79-8a66-350977677231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-13652fd8-6788-4111-8e17-d8f210d958e6 tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7aa702-4ecc-4a79-8a66-350977677231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-13652fd8-6788-4111-8e17-d8f210d958e6 tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f05bb0ed-b814-431e-a022-a9cd77121d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:30 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-13652fd8-6788-4111-8e17-d8f210d958e6 tempest-GroupSnapshotsTest-773077248 None] Volume b1784ccc-d470-4bb2-b340-5ffc2187c97a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a', 'volume_size': 1}
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-13652fd8-6788-4111-8e17-d8f210d958e6 tempest-GroupSnapshotsTest-773077248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-17c92ac5-9cd8-4c14-abec-e46905ce4ca0 tempest-CreateVolumesFromImageTest-77586842 None] Acquiring lock "cinder-75dc10ed-5598-4722-a07f-ecd3d4ffe003-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-17c92ac5-9cd8-4c14-abec-e46905ce4ca0 tempest-CreateVolumesFromImageTest-77586842 None] Lock "cinder-75dc10ed-5598-4722-a07f-ecd3d4ffe003-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-17c92ac5-9cd8-4c14-abec-e46905ce4ca0 tempest-CreateVolumesFromImageTest-77586842 None] Acquiring lock "cinder-quobyte-75dc10ed-5598-4722-a07f-ecd3d4ffe003" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-17c92ac5-9cd8-4c14-abec-e46905ce4ca0 tempest-CreateVolumesFromImageTest-77586842 None] Lock "cinder-quobyte-75dc10ed-5598-4722-a07f-ecd3d4ffe003" acquired by "delete_volume" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b1eb06-7495-4299-a82b-eafb4bff0b1f]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-17c92ac5-9cd8-4c14-abec-e46905ce4ca0 tempest-CreateVolumesFromImageTest-77586842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-75dc10ed-5598-4722-a07f-ecd3d4ffe003 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:30 devstack sudo[87136]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5a131640-6557-4dad-bf94-7fc791904a53 tempest-VolumesCloneNegativeTest-728148717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41391920-e263-4dd1-8e79-16807f7eca78" returned: 0 in 0.491s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5a131640-6557-4dad-bf94-7fc791904a53 tempest-VolumesCloneNegativeTest-728148717 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5a131640-6557-4dad-bf94-7fc791904a53 tempest-VolumesCloneNegativeTest-728148717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:30 devstack sudo[87139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-75dc10ed-5598-4722-a07f-ecd3d4ffe003
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-13652fd8-6788-4111-8e17-d8f210d958e6 tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.139s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:30 devstack sudo[87139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-13652fd8-6788-4111-8e17-d8f210d958e6 tempest-GroupSnapshotsTest-773077248 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f250d342-3790-4d7d-a858-56e0de0f5425,created_at=2026-04-02T08:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-106900284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f250d342-3790-4d7d-a858-56e0de0f5425,host='devstack@QuobyteHD#QuobyteHD',id=b1784ccc-d470-4bb2-b340-5ffc2187c97a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='715df5a8413948c3abcecf488c7f9810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:30Z,use_quota=True,user_id='59fae1ac304a413883534cd7e39c3820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59555be5-e02e-451c-bddd-d7ca0b565d7a),volume_type_id=59555be5-e02e-451c-bddd-d7ca0b565d7a)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-13652fd8-6788-4111-8e17-d8f210d958e6 tempest-GroupSnapshotsTest-773077248 None] Creating volume b1784ccc-d470-4bb2-b340-5ffc2187c97a {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-13652fd8-6788-4111-8e17-d8f210d958e6 tempest-GroupSnapshotsTest-773077248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-13652fd8-6788-4111-8e17-d8f210d958e6 tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-13652fd8-6788-4111-8e17-d8f210d958e6 tempest-GroupSnapshotsTest-773077248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-13652fd8-6788-4111-8e17-d8f210d958e6 tempest-GroupSnapshotsTest-773077248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-13652fd8-6788-4111-8e17-d8f210d958e6 tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-13652fd8-6788-4111-8e17-d8f210d958e6 tempest-GroupSnapshotsTest-773077248 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:29:30 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-13652fd8-6788-4111-8e17-d8f210d958e6 tempest-GroupSnapshotsTest-773077248 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-13652fd8-6788-4111-8e17-d8f210d958e6 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5a131640-6557-4dad-bf94-7fc791904a53 tempest-VolumesCloneNegativeTest-728148717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20578774-4cb3-431d-9444-0c9c50c9cbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41391920-e263-4dd1-8e79-16807f7eca78', 'volume_size': 2}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5a131640-6557-4dad-bf94-7fc791904a53 tempest-VolumesCloneNegativeTest-728148717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf7242ed-c233-45fa-8176-c3d4f5bd75f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:30 devstack sudo[87141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a 1073741824
Apr 02 10:29:30 devstack sudo[87141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:30 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-5a131640-6557-4dad-bf94-7fc791904a53 tempest-VolumesCloneNegativeTest-728148717 None] Volume volume-41391920-e263-4dd1-8e79-16807f7eca78 (41391920-e263-4dd1-8e79-16807f7eca78): created successfully
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5a131640-6557-4dad-bf94-7fc791904a53 tempest-VolumesCloneNegativeTest-728148717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf7242ed-c233-45fa-8176-c3d4f5bd75f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5a131640-6557-4dad-bf94-7fc791904a53 tempest-VolumesCloneNegativeTest-728148717 None] Flow 'volume_create_manager' (4a0d4c17-8a82-4595-8629-6bef7d053698) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:30 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-5a131640-6557-4dad-bf94-7fc791904a53 tempest-VolumesCloneNegativeTest-728148717 None] Created volume successfully.
Apr 02 10:29:30 devstack sudo[87139]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-e7924218-8b73-4c06-b0ff-fb1040c78382 tempest-VolumesCloneNegativeTest-728148717 None] Acquiring lock "cinder-41391920-e263-4dd1-8e79-16807f7eca78-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-17c92ac5-9cd8-4c14-abec-e46905ce4ca0 tempest-CreateVolumesFromImageTest-77586842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-75dc10ed-5598-4722-a07f-ecd3d4ffe003" returned: 0 in 0.553s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-17c92ac5-9cd8-4c14-abec-e46905ce4ca0 tempest-CreateVolumesFromImageTest-77586842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-75dc10ed-5598-4722-a07f-ecd3d4ffe003 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-e7924218-8b73-4c06-b0ff-fb1040c78382 tempest-VolumesCloneNegativeTest-728148717 None] Lock "cinder-41391920-e263-4dd1-8e79-16807f7eca78-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:30 devstack sudo[87149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-75dc10ed-5598-4722-a07f-ecd3d4ffe003
Apr 02 10:29:30 devstack sudo[87149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-e7924218-8b73-4c06-b0ff-fb1040c78382 tempest-VolumesCloneNegativeTest-728148717 None] Acquiring lock "cinder-quobyte-41391920-e263-4dd1-8e79-16807f7eca78" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-e7924218-8b73-4c06-b0ff-fb1040c78382 tempest-VolumesCloneNegativeTest-728148717 None] Lock "cinder-quobyte-41391920-e263-4dd1-8e79-16807f7eca78" acquired by "delete_volume" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c20515-35a1-4a48-aca3-639041418008]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e7924218-8b73-4c06-b0ff-fb1040c78382 tempest-VolumesCloneNegativeTest-728148717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41391920-e263-4dd1-8e79-16807f7eca78 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:30 devstack sudo[87141]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-13652fd8-6788-4111-8e17-d8f210d958e6 tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a 1073741824" returned: 0 in 0.607s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-13652fd8-6788-4111-8e17-d8f210d958e6 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:30 devstack sudo[87151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41391920-e263-4dd1-8e79-16807f7eca78
Apr 02 10:29:30 devstack sudo[87151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:30 devstack sudo[87152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a
Apr 02 10:29:30 devstack sudo[87152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:31 devstack sudo[87149]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-17c92ac5-9cd8-4c14-abec-e46905ce4ca0 tempest-CreateVolumesFromImageTest-77586842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-75dc10ed-5598-4722-a07f-ecd3d4ffe003" returned: 0 in 0.469s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-17c92ac5-9cd8-4c14-abec-e46905ce4ca0 tempest-CreateVolumesFromImageTest-77586842 None] Lock "cinder-quobyte-75dc10ed-5598-4722-a07f-ecd3d4ffe003" released by "delete_volume" :: held 1.052s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-17c92ac5-9cd8-4c14-abec-e46905ce4ca0 tempest-CreateVolumesFromImageTest-77586842 None] Created reservations ['37422463-4f3b-4c8e-8cc2-70c949f0f78b', '0209e12b-3072-4fd1-b58b-d6ba7154925e', '54b947c9-565c-4ac5-abea-ae847753dba9', 'a852b088-27d0-47a4-992d-b965fa76020d'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-17c92ac5-9cd8-4c14-abec-e46905ce4ca0 tempest-CreateVolumesFromImageTest-77586842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-17c92ac5-9cd8-4c14-abec-e46905ce4ca0 tempest-CreateVolumesFromImageTest-77586842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-17c92ac5-9cd8-4c14-abec-e46905ce4ca0 tempest-CreateVolumesFromImageTest-77586842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-17c92ac5-9cd8-4c14-abec-e46905ce4ca0 tempest-CreateVolumesFromImageTest-77586842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-17c92ac5-9cd8-4c14-abec-e46905ce4ca0 tempest-CreateVolumesFromImageTest-77586842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-17c92ac5-9cd8-4c14-abec-e46905ce4ca0 tempest-CreateVolumesFromImageTest-77586842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:31 devstack sudo[87161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:29:31 devstack sudo[87161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:31 devstack sudo[87151]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e7924218-8b73-4c06-b0ff-fb1040c78382 tempest-VolumesCloneNegativeTest-728148717 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41391920-e263-4dd1-8e79-16807f7eca78" returned: 0 in 0.531s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e7924218-8b73-4c06-b0ff-fb1040c78382 tempest-VolumesCloneNegativeTest-728148717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41391920-e263-4dd1-8e79-16807f7eca78 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:31 devstack sudo[87163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41391920-e263-4dd1-8e79-16807f7eca78
Apr 02 10:29:31 devstack sudo[87152]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:31 devstack sudo[87163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-13652fd8-6788-4111-8e17-d8f210d958e6 tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a" returned: 0 in 0.482s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-13652fd8-6788-4111-8e17-d8f210d958e6 tempest-GroupSnapshotsTest-773077248 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-13652fd8-6788-4111-8e17-d8f210d958e6 tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-13652fd8-6788-4111-8e17-d8f210d958e6 tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f05bb0ed-b814-431e-a022-a9cd77121d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-13652fd8-6788-4111-8e17-d8f210d958e6 tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (950d696b-c337-4eba-a651-e983010d335c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:31 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-13652fd8-6788-4111-8e17-d8f210d958e6 tempest-GroupSnapshotsTest-773077248 None] Volume volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a (b1784ccc-d470-4bb2-b340-5ffc2187c97a): created successfully
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-13652fd8-6788-4111-8e17-d8f210d958e6 tempest-GroupSnapshotsTest-773077248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (950d696b-c337-4eba-a651-e983010d335c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-13652fd8-6788-4111-8e17-d8f210d958e6 tempest-GroupSnapshotsTest-773077248 None] Flow 'volume_create_manager' (5e4128d9-49a1-47cc-b7ee-7bb419447976) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:31 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-13652fd8-6788-4111-8e17-d8f210d958e6 tempest-GroupSnapshotsTest-773077248 None] Created volume successfully.
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-118424b1-7869-4d6e-b14c-bed94e94dbee tempest-VolumesActionsTest-1099538795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-118424b1-7869-4d6e-b14c-bed94e94dbee tempest-VolumesActionsTest-1099538795 None] Flow 'volume_create_manager' (118bf545-a72c-45fb-b9a3-3089f71f7d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-118424b1-7869-4d6e-b14c-bed94e94dbee tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7939a989-4b1e-474c-b013-1ad8c0052f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-118424b1-7869-4d6e-b14c-bed94e94dbee tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7939a989-4b1e-474c-b013-1ad8c0052f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1606577183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0656530-7d93-4b3a-8bcf-f38f3a5e07b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92cd48ebe8bf4c4d8acbf4c15968d823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:32Z,use_quota=True,user_id='1e0b000a1a39462998b46dd57ca6b695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-118424b1-7869-4d6e-b14c-bed94e94dbee tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1feba6e-82e2-464e-a539-7b711a6e7470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-118424b1-7869-4d6e-b14c-bed94e94dbee tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1feba6e-82e2-464e-a539-7b711a6e7470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-118424b1-7869-4d6e-b14c-bed94e94dbee tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (571a394c-bbcf-40a2-a22c-4cd42b9f8873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-118424b1-7869-4d6e-b14c-bed94e94dbee tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (571a394c-bbcf-40a2-a22c-4cd42b9f8873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0656530-7d93-4b3a-8bcf-f38f3a5e07b5', 'volume_name': 'volume-e0656530-7d93-4b3a-8bcf-f38f3a5e07b5', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-118424b1-7869-4d6e-b14c-bed94e94dbee tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c78fa5cd-a3f0-4080-bc59-fdb492f9987a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-118424b1-7869-4d6e-b14c-bed94e94dbee tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c78fa5cd-a3f0-4080-bc59-fdb492f9987a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-118424b1-7869-4d6e-b14c-bed94e94dbee tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54534595-13d2-4423-a883-5c3298c08948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:31 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-118424b1-7869-4d6e-b14c-bed94e94dbee tempest-VolumesActionsTest-1099538795 None] Volume e0656530-7d93-4b3a-8bcf-f38f3a5e07b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0656530-7d93-4b3a-8bcf-f38f3a5e07b5', 'volume_size': 1}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-118424b1-7869-4d6e-b14c-bed94e94dbee tempest-VolumesActionsTest-1099538795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-118424b1-7869-4d6e-b14c-bed94e94dbee tempest-VolumesActionsTest-1099538795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-118424b1-7869-4d6e-b14c-bed94e94dbee tempest-VolumesActionsTest-1099538795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1606577183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0656530-7d93-4b3a-8bcf-f38f3a5e07b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92cd48ebe8bf4c4d8acbf4c15968d823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:32Z,use_quota=True,user_id='1e0b000a1a39462998b46dd57ca6b695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-118424b1-7869-4d6e-b14c-bed94e94dbee tempest-VolumesActionsTest-1099538795 None] Creating volume e0656530-7d93-4b3a-8bcf-f38f3a5e07b5 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-118424b1-7869-4d6e-b14c-bed94e94dbee tempest-VolumesActionsTest-1099538795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-118424b1-7869-4d6e-b14c-bed94e94dbee tempest-VolumesActionsTest-1099538795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-118424b1-7869-4d6e-b14c-bed94e94dbee tempest-VolumesActionsTest-1099538795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-118424b1-7869-4d6e-b14c-bed94e94dbee tempest-VolumesActionsTest-1099538795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-118424b1-7869-4d6e-b14c-bed94e94dbee tempest-VolumesActionsTest-1099538795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-118424b1-7869-4d6e-b14c-bed94e94dbee tempest-VolumesActionsTest-1099538795 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:29:31 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-118424b1-7869-4d6e-b14c-bed94e94dbee tempest-VolumesActionsTest-1099538795 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-118424b1-7869-4d6e-b14c-bed94e94dbee tempest-VolumesActionsTest-1099538795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e0656530-7d93-4b3a-8bcf-f38f3a5e07b5 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:31 devstack sudo[87167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e0656530-7d93-4b3a-8bcf-f38f3a5e07b5 1073741824
Apr 02 10:29:31 devstack sudo[87167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:31 devstack sudo[87161]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-17c92ac5-9cd8-4c14-abec-e46905ce4ca0 tempest-CreateVolumesFromImageTest-77586842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.513s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-17c92ac5-9cd8-4c14-abec-e46905ce4ca0 tempest-CreateVolumesFromImageTest-77586842 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:29:31 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-17c92ac5-9cd8-4c14-abec-e46905ce4ca0 tempest-CreateVolumesFromImageTest-77586842 None] Deleted volume successfully.
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-17c92ac5-9cd8-4c14-abec-e46905ce4ca0 tempest-CreateVolumesFromImageTest-77586842 None] Lock "cinder-75dc10ed-5598-4722-a07f-ecd3d4ffe003-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:31 devstack sudo[87163]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e7924218-8b73-4c06-b0ff-fb1040c78382 tempest-VolumesCloneNegativeTest-728148717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41391920-e263-4dd1-8e79-16807f7eca78" returned: 0 in 0.519s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-e7924218-8b73-4c06-b0ff-fb1040c78382 tempest-VolumesCloneNegativeTest-728148717 None] Lock "cinder-quobyte-41391920-e263-4dd1-8e79-16807f7eca78" released by "delete_volume" :: held 1.072s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-e7924218-8b73-4c06-b0ff-fb1040c78382 tempest-VolumesCloneNegativeTest-728148717 None] Created reservations ['920d11a9-0f62-455c-aeb9-af318851073b', 'b2a1222a-d4da-405e-9150-f6bb2ae7f5cf', '4e0af62a-4221-48ee-af54-e17a85b43f44', '5d7a3634-939a-4d59-b913-bb23171c969b'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e7924218-8b73-4c06-b0ff-fb1040c78382 tempest-VolumesCloneNegativeTest-728148717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e7924218-8b73-4c06-b0ff-fb1040c78382 tempest-VolumesCloneNegativeTest-728148717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e7924218-8b73-4c06-b0ff-fb1040c78382 tempest-VolumesCloneNegativeTest-728148717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e7924218-8b73-4c06-b0ff-fb1040c78382 tempest-VolumesCloneNegativeTest-728148717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e7924218-8b73-4c06-b0ff-fb1040c78382 tempest-VolumesCloneNegativeTest-728148717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e7924218-8b73-4c06-b0ff-fb1040c78382 tempest-VolumesCloneNegativeTest-728148717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:31 devstack sudo[87169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:29:31 devstack sudo[87169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:32 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-6887385f-dae6-4e96-9d88-ff7990cd3b3e tempest-CreateVolumesFromImageTest-77586842 None] Acquiring lock "cinder-97596bd1-9f04-4932-8b03-bd7308fd9cb7-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:32 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-6887385f-dae6-4e96-9d88-ff7990cd3b3e tempest-CreateVolumesFromImageTest-77586842 None] Lock "cinder-97596bd1-9f04-4932-8b03-bd7308fd9cb7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:32 devstack sudo[87167]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:32 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-8fe1652d-0229-4c5a-88b5-1e50030affb2 tempest-GroupSnapshotsTest-773077248 None] GroupSnapshot fa2fa128-9144-4645-af1c-e8374ea36d7c: creating.
Apr 02 10:29:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-118424b1-7869-4d6e-b14c-bed94e94dbee tempest-VolumesActionsTest-1099538795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e0656530-7d93-4b3a-8bcf-f38f3a5e07b5 1073741824" returned: 0 in 0.580s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:32 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-6887385f-dae6-4e96-9d88-ff7990cd3b3e tempest-CreateVolumesFromImageTest-77586842 None] Acquiring lock "cinder-quobyte-97596bd1-9f04-4932-8b03-bd7308fd9cb7" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8fe1652d-0229-4c5a-88b5-1e50030affb2 tempest-GroupSnapshotsTest-773077248 None] Group snapshot fa2fa128-9144-4645-af1c-e8374ea36d7c: creating. {{(pid=82102) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 02 10:29:32 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-6887385f-dae6-4e96-9d88-ff7990cd3b3e tempest-CreateVolumesFromImageTest-77586842 None] Lock "cinder-quobyte-97596bd1-9f04-4932-8b03-bd7308fd9cb7" acquired by "delete_volume" :: waited 0.020s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8fe1652d-0229-4c5a-88b5-1e50030affb2 tempest-GroupSnapshotsTest-773077248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:32 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a15ce4a-0297-4b65-95a3-aa45f97f4aa1]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:29:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6887385f-dae6-4e96-9d88-ff7990cd3b3e tempest-CreateVolumesFromImageTest-77586842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-97596bd1-9f04-4932-8b03-bd7308fd9cb7 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-118424b1-7869-4d6e-b14c-bed94e94dbee tempest-VolumesActionsTest-1099538795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e0656530-7d93-4b3a-8bcf-f38f3a5e07b5 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:32 devstack sudo[87176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e0656530-7d93-4b3a-8bcf-f38f3a5e07b5
Apr 02 10:29:32 devstack sudo[87176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:32 devstack sudo[87169]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e7924218-8b73-4c06-b0ff-fb1040c78382 tempest-VolumesCloneNegativeTest-728148717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.518s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:32 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-e7924218-8b73-4c06-b0ff-fb1040c78382 tempest-VolumesCloneNegativeTest-728148717 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:29:32 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-e7924218-8b73-4c06-b0ff-fb1040c78382 tempest-VolumesCloneNegativeTest-728148717 None] Deleted volume successfully.
Apr 02 10:29:32 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-e7924218-8b73-4c06-b0ff-fb1040c78382 tempest-VolumesCloneNegativeTest-728148717 None] Lock "cinder-41391920-e263-4dd1-8e79-16807f7eca78-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:32 devstack sudo[87175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-97596bd1-9f04-4932-8b03-bd7308fd9cb7
Apr 02 10:29:32 devstack sudo[87175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:32 devstack sudo[87176]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-118424b1-7869-4d6e-b14c-bed94e94dbee tempest-VolumesActionsTest-1099538795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e0656530-7d93-4b3a-8bcf-f38f3a5e07b5" returned: 0 in 0.489s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:32 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-118424b1-7869-4d6e-b14c-bed94e94dbee tempest-VolumesActionsTest-1099538795 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:29:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-118424b1-7869-4d6e-b14c-bed94e94dbee tempest-VolumesActionsTest-1099538795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8fe1652d-0229-4c5a-88b5-1e50030affb2 tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.510s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-118424b1-7869-4d6e-b14c-bed94e94dbee tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54534595-13d2-4423-a883-5c3298c08948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0656530-7d93-4b3a-8bcf-f38f3a5e07b5', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-118424b1-7869-4d6e-b14c-bed94e94dbee tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b04b48e-89c3-4868-9760-c618038b3473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:32 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-8fe1652d-0229-4c5a-88b5-1e50030affb2 tempest-GroupSnapshotsTest-773077248 None] Creating offline snapshot 678d95b9-46b9-43a0-bc04-8ac61cd0c335 of volume b1784ccc-d470-4bb2-b340-5ffc2187c97a {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:29:32 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-118424b1-7869-4d6e-b14c-bed94e94dbee tempest-VolumesActionsTest-1099538795 None] Volume volume-e0656530-7d93-4b3a-8bcf-f38f3a5e07b5 (e0656530-7d93-4b3a-8bcf-f38f3a5e07b5): created successfully
Apr 02 10:29:32 devstack sudo[87175]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-118424b1-7869-4d6e-b14c-bed94e94dbee tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b04b48e-89c3-4868-9760-c618038b3473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-118424b1-7869-4d6e-b14c-bed94e94dbee tempest-VolumesActionsTest-1099538795 None] Flow 'volume_create_manager' (118bf545-a72c-45fb-b9a3-3089f71f7d20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:32 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96521cb-4838-4673-a310-c00e513ca5fe]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:29:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8fe1652d-0229-4c5a-88b5-1e50030affb2 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6887385f-dae6-4e96-9d88-ff7990cd3b3e tempest-CreateVolumesFromImageTest-77586842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-97596bd1-9f04-4932-8b03-bd7308fd9cb7" returned: 0 in 0.593s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6887385f-dae6-4e96-9d88-ff7990cd3b3e tempest-CreateVolumesFromImageTest-77586842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-97596bd1-9f04-4932-8b03-bd7308fd9cb7 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:32 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-118424b1-7869-4d6e-b14c-bed94e94dbee tempest-VolumesActionsTest-1099538795 None] Created volume successfully.
Apr 02 10:29:32 devstack sudo[87184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-97596bd1-9f04-4932-8b03-bd7308fd9cb7
Apr 02 10:29:32 devstack sudo[87184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:32 devstack sudo[87183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a
Apr 02 10:29:32 devstack sudo[87183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:33 devstack sudo[87184]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6887385f-dae6-4e96-9d88-ff7990cd3b3e tempest-CreateVolumesFromImageTest-77586842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-97596bd1-9f04-4932-8b03-bd7308fd9cb7" returned: 0 in 0.525s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:33 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-6887385f-dae6-4e96-9d88-ff7990cd3b3e tempest-CreateVolumesFromImageTest-77586842 None] Lock "cinder-quobyte-97596bd1-9f04-4932-8b03-bd7308fd9cb7" released by "delete_volume" :: held 1.149s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:33 devstack sudo[87183]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8fe1652d-0229-4c5a-88b5-1e50030affb2 tempest-GroupSnapshotsTest-773077248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a" returned: 0 in 0.558s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8fe1652d-0229-4c5a-88b5-1e50030affb2 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a.678d95b9-46b9-43a0-bc04-8ac61cd0c335 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:33 devstack sudo[87191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a.678d95b9-46b9-43a0-bc04-8ac61cd0c335 1G
Apr 02 10:29:33 devstack sudo[87191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:33 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-6887385f-dae6-4e96-9d88-ff7990cd3b3e tempest-CreateVolumesFromImageTest-77586842 None] Created reservations ['8604e856-454c-4ec1-a69b-2ec1ed16e544', 'fd347bf2-da94-47ef-947b-dc37bc9c1c5b', 'e90f709f-33b3-4aa0-a427-6e5e31994426', '5256e495-19a5-4c3c-9900-74297530b228'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:29:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-6887385f-dae6-4e96-9d88-ff7990cd3b3e tempest-CreateVolumesFromImageTest-77586842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-6887385f-dae6-4e96-9d88-ff7990cd3b3e tempest-CreateVolumesFromImageTest-77586842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:33 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-6887385f-dae6-4e96-9d88-ff7990cd3b3e tempest-CreateVolumesFromImageTest-77586842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:33 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-6887385f-dae6-4e96-9d88-ff7990cd3b3e tempest-CreateVolumesFromImageTest-77586842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-6887385f-dae6-4e96-9d88-ff7990cd3b3e tempest-CreateVolumesFromImageTest-77586842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6887385f-dae6-4e96-9d88-ff7990cd3b3e tempest-CreateVolumesFromImageTest-77586842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:33 devstack sudo[87193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:29:33 devstack sudo[87193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:33 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-0f84c42c-7717-4474-ae33-1e429f0961e1 tempest-VolumesActionsTest-2043573547 None] Acquiring lock "cinder-e0656530-7d93-4b3a-8bcf-f38f3a5e07b5-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:33 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-0f84c42c-7717-4474-ae33-1e429f0961e1 tempest-VolumesActionsTest-2043573547 None] Lock "cinder-e0656530-7d93-4b3a-8bcf-f38f3a5e07b5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:33 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-0f84c42c-7717-4474-ae33-1e429f0961e1 tempest-VolumesActionsTest-2043573547 None] Acquiring lock "cinder-quobyte-e0656530-7d93-4b3a-8bcf-f38f3a5e07b5" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:33 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-0f84c42c-7717-4474-ae33-1e429f0961e1 tempest-VolumesActionsTest-2043573547 None] Lock "cinder-quobyte-e0656530-7d93-4b3a-8bcf-f38f3a5e07b5" acquired by "delete_volume" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:33 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b0e6ef-b102-49c6-91eb-4cb00cc76740]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:29:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0f84c42c-7717-4474-ae33-1e429f0961e1 tempest-VolumesActionsTest-2043573547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e0656530-7d93-4b3a-8bcf-f38f3a5e07b5 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:34 devstack sudo[87193]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6887385f-dae6-4e96-9d88-ff7990cd3b3e tempest-CreateVolumesFromImageTest-77586842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.487s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:34 devstack sudo[87199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e0656530-7d93-4b3a-8bcf-f38f3a5e07b5
Apr 02 10:29:34 devstack sudo[87199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:34 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-6887385f-dae6-4e96-9d88-ff7990cd3b3e tempest-CreateVolumesFromImageTest-77586842 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:29:34 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-6887385f-dae6-4e96-9d88-ff7990cd3b3e tempest-CreateVolumesFromImageTest-77586842 None] Deleted volume successfully.
Apr 02 10:29:34 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-6887385f-dae6-4e96-9d88-ff7990cd3b3e tempest-CreateVolumesFromImageTest-77586842 None] Lock "cinder-97596bd1-9f04-4932-8b03-bd7308fd9cb7-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:34 devstack sudo[87191]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8fe1652d-0229-4c5a-88b5-1e50030affb2 tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a.678d95b9-46b9-43a0-bc04-8ac61cd0c335 1G" returned: 0 in 0.642s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8fe1652d-0229-4c5a-88b5-1e50030affb2 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a.678d95b9-46b9-43a0-bc04-8ac61cd0c335 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:34 devstack sudo[87201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a.678d95b9-46b9-43a0-bc04-8ac61cd0c335
Apr 02 10:29:34 devstack sudo[87201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:34 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-22eb6a0d-85bf-4aeb-81d7-51eaab2d4836 tempest-CreateVolumesFromImageTest-77586842 None] Acquiring lock "cinder-7899bcea-3583-42df-bfd2-2592a437302a-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:34 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-22eb6a0d-85bf-4aeb-81d7-51eaab2d4836 tempest-CreateVolumesFromImageTest-77586842 None] Lock "cinder-7899bcea-3583-42df-bfd2-2592a437302a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:34 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-22eb6a0d-85bf-4aeb-81d7-51eaab2d4836 tempest-CreateVolumesFromImageTest-77586842 None] Acquiring lock "cinder-quobyte-7899bcea-3583-42df-bfd2-2592a437302a" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:34 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-22eb6a0d-85bf-4aeb-81d7-51eaab2d4836 tempest-CreateVolumesFromImageTest-77586842 None] Lock "cinder-quobyte-7899bcea-3583-42df-bfd2-2592a437302a" acquired by "delete_volume" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:34 devstack sudo[87199]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0f84c42c-7717-4474-ae33-1e429f0961e1 tempest-VolumesActionsTest-2043573547 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e0656530-7d93-4b3a-8bcf-f38f3a5e07b5" returned: 0 in 0.546s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0f84c42c-7717-4474-ae33-1e429f0961e1 tempest-VolumesActionsTest-2043573547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e0656530-7d93-4b3a-8bcf-f38f3a5e07b5 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:34 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[142c2cbf-f55b-4cb9-9021-e800f732253d]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:29:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-22eb6a0d-85bf-4aeb-81d7-51eaab2d4836 tempest-CreateVolumesFromImageTest-77586842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-7899bcea-3583-42df-bfd2-2592a437302a {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:34 devstack sudo[87206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e0656530-7d93-4b3a-8bcf-f38f3a5e07b5
Apr 02 10:29:34 devstack sudo[87206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:34 devstack sudo[87207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-7899bcea-3583-42df-bfd2-2592a437302a
Apr 02 10:29:34 devstack sudo[87207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:34 devstack sudo[87201]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8fe1652d-0229-4c5a-88b5-1e50030affb2 tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a.678d95b9-46b9-43a0-bc04-8ac61cd0c335" returned: 0 in 0.585s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:34 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-8fe1652d-0229-4c5a-88b5-1e50030affb2 tempest-GroupSnapshotsTest-773077248 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a.678d95b9-46b9-43a0-bc04-8ac61cd0c335 is being set with open permissions: ugo+rw: NotImplementedError
Apr 02 10:29:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8fe1652d-0229-4c5a-88b5-1e50030affb2 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a.678d95b9-46b9-43a0-bc04-8ac61cd0c335 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:34 devstack sudo[87213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a.678d95b9-46b9-43a0-bc04-8ac61cd0c335
Apr 02 10:29:34 devstack sudo[87213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:34 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-93c4c4a6-fa6e-4a53-a08f-311d8d2f7481 tempest-VolumesListTestJSON-1077070625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:29:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-93c4c4a6-fa6e-4a53-a08f-311d8d2f7481 tempest-VolumesListTestJSON-1077070625 None] Flow 'volume_create_manager' (127d70b4-1c8f-43ff-800f-3582f49c7cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-93c4c4a6-fa6e-4a53-a08f-311d8d2f7481 tempest-VolumesListTestJSON-1077070625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98305cb4-a1b3-4da2-9fee-09e7ceef3df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:35 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-93c4c4a6-fa6e-4a53-a08f-311d8d2f7481 tempest-VolumesListTestJSON-1077070625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98305cb4-a1b3-4da2-9fee-09e7ceef3df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2034717291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4120049-eff3-42f1-a03d-1114a69fb25c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8f07de7cd6d4c22905c9cf27baa288b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:35Z,use_quota=True,user_id='7bb79b698c464abca3587a66b293ea13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:35 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-93c4c4a6-fa6e-4a53-a08f-311d8d2f7481 tempest-VolumesListTestJSON-1077070625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90365f80-fb4d-4bd2-9ae5-0ed57a8b0368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:35 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-93c4c4a6-fa6e-4a53-a08f-311d8d2f7481 tempest-VolumesListTestJSON-1077070625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90365f80-fb4d-4bd2-9ae5-0ed57a8b0368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:35 devstack sudo[87206]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:35 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-93c4c4a6-fa6e-4a53-a08f-311d8d2f7481 tempest-VolumesListTestJSON-1077070625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1187d9d5-ba98-44db-8956-d1df89cbd61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:35 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-93c4c4a6-fa6e-4a53-a08f-311d8d2f7481 tempest-VolumesListTestJSON-1077070625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1187d9d5-ba98-44db-8956-d1df89cbd61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4120049-eff3-42f1-a03d-1114a69fb25c', 'volume_name': 'volume-b4120049-eff3-42f1-a03d-1114a69fb25c', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:35 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-93c4c4a6-fa6e-4a53-a08f-311d8d2f7481 tempest-VolumesListTestJSON-1077070625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c865ec-bc0b-4717-87e1-4f61e7a2ac15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:35 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-93c4c4a6-fa6e-4a53-a08f-311d8d2f7481 tempest-VolumesListTestJSON-1077070625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c865ec-bc0b-4717-87e1-4f61e7a2ac15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:35 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-93c4c4a6-fa6e-4a53-a08f-311d8d2f7481 tempest-VolumesListTestJSON-1077070625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (236488d7-c116-45f3-bc18-09d5a6465d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:35 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-93c4c4a6-fa6e-4a53-a08f-311d8d2f7481 tempest-VolumesListTestJSON-1077070625 None] Volume b4120049-eff3-42f1-a03d-1114a69fb25c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4120049-eff3-42f1-a03d-1114a69fb25c', 'volume_size': 1}
Apr 02 10:29:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-93c4c4a6-fa6e-4a53-a08f-311d8d2f7481 tempest-VolumesListTestJSON-1077070625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0f84c42c-7717-4474-ae33-1e429f0961e1 tempest-VolumesActionsTest-2043573547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e0656530-7d93-4b3a-8bcf-f38f3a5e07b5" returned: 0 in 0.538s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:35 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-0f84c42c-7717-4474-ae33-1e429f0961e1 tempest-VolumesActionsTest-2043573547 None] Lock "cinder-quobyte-e0656530-7d93-4b3a-8bcf-f38f3a5e07b5" released by "delete_volume" :: held 1.120s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:35 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-0f84c42c-7717-4474-ae33-1e429f0961e1 tempest-VolumesActionsTest-2043573547 None] Created reservations ['d2a061b7-823b-4294-8e92-d58a9b7f7aa6', 'cf3ddc26-2559-4935-aada-cbb90cf15f52', 'd931ccaf-c9eb-45d6-bd5c-8f4cb6bec96c', 'f7553b12-ae29-48c6-9cac-e04f4d5b05ae'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:29:35 devstack sudo[87207]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-22eb6a0d-85bf-4aeb-81d7-51eaab2d4836 tempest-CreateVolumesFromImageTest-77586842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-7899bcea-3583-42df-bfd2-2592a437302a" returned: 0 in 0.577s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-22eb6a0d-85bf-4aeb-81d7-51eaab2d4836 tempest-CreateVolumesFromImageTest-77586842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-7899bcea-3583-42df-bfd2-2592a437302a {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:35 devstack sudo[87219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-7899bcea-3583-42df-bfd2-2592a437302a
Apr 02 10:29:35 devstack sudo[87219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-0f84c42c-7717-4474-ae33-1e429f0961e1 tempest-VolumesActionsTest-2043573547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-0f84c42c-7717-4474-ae33-1e429f0961e1 tempest-VolumesActionsTest-2043573547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:35 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-0f84c42c-7717-4474-ae33-1e429f0961e1 tempest-VolumesActionsTest-2043573547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:35 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-0f84c42c-7717-4474-ae33-1e429f0961e1 tempest-VolumesActionsTest-2043573547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-0f84c42c-7717-4474-ae33-1e429f0961e1 tempest-VolumesActionsTest-2043573547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0f84c42c-7717-4474-ae33-1e429f0961e1 tempest-VolumesActionsTest-2043573547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:35 devstack sudo[87222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:29:35 devstack sudo[87222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:35 devstack sudo[87213]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8fe1652d-0229-4c5a-88b5-1e50030affb2 tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a.678d95b9-46b9-43a0-bc04-8ac61cd0c335" returned: 0 in 0.511s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8fe1652d-0229-4c5a-88b5-1e50030affb2 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:35 devstack sudo[87224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a.info
Apr 02 10:29:35 devstack sudo[87224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:35 devstack sudo[87219]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-22eb6a0d-85bf-4aeb-81d7-51eaab2d4836 tempest-CreateVolumesFromImageTest-77586842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-7899bcea-3583-42df-bfd2-2592a437302a" returned: 0 in 0.410s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:35 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-22eb6a0d-85bf-4aeb-81d7-51eaab2d4836 tempest-CreateVolumesFromImageTest-77586842 None] Lock "cinder-quobyte-7899bcea-3583-42df-bfd2-2592a437302a" released by "delete_volume" :: held 1.024s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:35 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-22eb6a0d-85bf-4aeb-81d7-51eaab2d4836 tempest-CreateVolumesFromImageTest-77586842 None] Created reservations ['d5812bda-b63c-48cb-b9bb-c016589bfbb3', 'be75a704-491a-4792-a5a2-acab78843777', '99dd98f6-6762-4eb0-b53e-8efc0e9c8e72', '74fb5145-1674-45ac-a075-f01c2c1e6a56'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:29:35 devstack sudo[87222]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0f84c42c-7717-4474-ae33-1e429f0961e1 tempest-VolumesActionsTest-2043573547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.452s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:35 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-0f84c42c-7717-4474-ae33-1e429f0961e1 tempest-VolumesActionsTest-2043573547 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:29:35 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-0f84c42c-7717-4474-ae33-1e429f0961e1 tempest-VolumesActionsTest-2043573547 None] Deleted volume successfully.
Apr 02 10:29:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-22eb6a0d-85bf-4aeb-81d7-51eaab2d4836 tempest-CreateVolumesFromImageTest-77586842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-22eb6a0d-85bf-4aeb-81d7-51eaab2d4836 tempest-CreateVolumesFromImageTest-77586842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:35 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-22eb6a0d-85bf-4aeb-81d7-51eaab2d4836 tempest-CreateVolumesFromImageTest-77586842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:35 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-22eb6a0d-85bf-4aeb-81d7-51eaab2d4836 tempest-CreateVolumesFromImageTest-77586842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-22eb6a0d-85bf-4aeb-81d7-51eaab2d4836 tempest-CreateVolumesFromImageTest-77586842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-22eb6a0d-85bf-4aeb-81d7-51eaab2d4836 tempest-CreateVolumesFromImageTest-77586842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:35 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-0f84c42c-7717-4474-ae33-1e429f0961e1 tempest-VolumesActionsTest-2043573547 None] Lock "cinder-e0656530-7d93-4b3a-8bcf-f38f3a5e07b5-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:35 devstack sudo[87229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:29:35 devstack sudo[87229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:35 devstack sudo[87224]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8fe1652d-0229-4c5a-88b5-1e50030affb2 tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a.info" returned: 0 in 0.446s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:35 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-8fe1652d-0229-4c5a-88b5-1e50030affb2 tempest-GroupSnapshotsTest-773077248 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 02 10:29:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8fe1652d-0229-4c5a-88b5-1e50030affb2 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:35 devstack sudo[87231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a.info
Apr 02 10:29:35 devstack sudo[87231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:36 devstack sudo[87229]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-22eb6a0d-85bf-4aeb-81d7-51eaab2d4836 tempest-CreateVolumesFromImageTest-77586842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.444s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-22eb6a0d-85bf-4aeb-81d7-51eaab2d4836 tempest-CreateVolumesFromImageTest-77586842 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:29:36 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-22eb6a0d-85bf-4aeb-81d7-51eaab2d4836 tempest-CreateVolumesFromImageTest-77586842 None] Deleted volume successfully.
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-22eb6a0d-85bf-4aeb-81d7-51eaab2d4836 tempest-CreateVolumesFromImageTest-77586842 None] Lock "cinder-7899bcea-3583-42df-bfd2-2592a437302a-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:36 devstack sudo[87231]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8fe1652d-0229-4c5a-88b5-1e50030affb2 tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a.info" returned: 0 in 0.420s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8fe1652d-0229-4c5a-88b5-1e50030affb2 tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.270s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-93c4c4a6-fa6e-4a53-a08f-311d8d2f7481 tempest-VolumesListTestJSON-1077070625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.067s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-93c4c4a6-fa6e-4a53-a08f-311d8d2f7481 tempest-VolumesListTestJSON-1077070625 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2034717291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4120049-eff3-42f1-a03d-1114a69fb25c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8f07de7cd6d4c22905c9cf27baa288b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:35Z,use_quota=True,user_id='7bb79b698c464abca3587a66b293ea13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-93c4c4a6-fa6e-4a53-a08f-311d8d2f7481 tempest-VolumesListTestJSON-1077070625 None] Creating volume b4120049-eff3-42f1-a03d-1114a69fb25c {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-93c4c4a6-fa6e-4a53-a08f-311d8d2f7481 tempest-VolumesListTestJSON-1077070625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-93c4c4a6-fa6e-4a53-a08f-311d8d2f7481 tempest-VolumesListTestJSON-1077070625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-93c4c4a6-fa6e-4a53-a08f-311d8d2f7481 tempest-VolumesListTestJSON-1077070625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-93c4c4a6-fa6e-4a53-a08f-311d8d2f7481 tempest-VolumesListTestJSON-1077070625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-93c4c4a6-fa6e-4a53-a08f-311d8d2f7481 tempest-VolumesListTestJSON-1077070625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-93c4c4a6-fa6e-4a53-a08f-311d8d2f7481 tempest-VolumesListTestJSON-1077070625 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:29:36 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-93c4c4a6-fa6e-4a53-a08f-311d8d2f7481 tempest-VolumesListTestJSON-1077070625 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-93c4c4a6-fa6e-4a53-a08f-311d8d2f7481 tempest-VolumesListTestJSON-1077070625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b4120049-eff3-42f1-a03d-1114a69fb25c 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:36 devstack sudo[87235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b4120049-eff3-42f1-a03d-1114a69fb25c 1073741824
Apr 02 10:29:36 devstack sudo[87235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:36 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-8fe1652d-0229-4c5a-88b5-1e50030affb2 tempest-GroupSnapshotsTest-773077248 None] group_snapshot fa2fa128-9144-4645-af1c-e8374ea36d7c: created successfully
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-99b19938-fcf4-4fee-9331-d0ffbe6e803f tempest-VolumesActionsTest-1099538795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-99b19938-fcf4-4fee-9331-d0ffbe6e803f tempest-VolumesActionsTest-1099538795 None] Flow 'volume_create_manager' (707098eb-5250-4466-830d-9f9ee28e827a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-99b19938-fcf4-4fee-9331-d0ffbe6e803f tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a9ccf75-2f23-4311-bd20-e7e752945b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-99b19938-fcf4-4fee-9331-d0ffbe6e803f tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a9ccf75-2f23-4311-bd20-e7e752945b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-309001720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cae558d6-ca0b-4939-82ef-c1f86908c649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92cd48ebe8bf4c4d8acbf4c15968d823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:36Z,use_quota=True,user_id='1e0b000a1a39462998b46dd57ca6b695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-99b19938-fcf4-4fee-9331-d0ffbe6e803f tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70e8293d-81f6-4fbe-bac3-f822e411b069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-99b19938-fcf4-4fee-9331-d0ffbe6e803f tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70e8293d-81f6-4fbe-bac3-f822e411b069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-99b19938-fcf4-4fee-9331-d0ffbe6e803f tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0f495c7-6f70-41da-851c-a243abb8e097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-99b19938-fcf4-4fee-9331-d0ffbe6e803f tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0f495c7-6f70-41da-851c-a243abb8e097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cae558d6-ca0b-4939-82ef-c1f86908c649', 'volume_name': 'volume-cae558d6-ca0b-4939-82ef-c1f86908c649', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-99b19938-fcf4-4fee-9331-d0ffbe6e803f tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (448b03ce-18cf-44f2-bfe4-c4d1e10dae02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-99b19938-fcf4-4fee-9331-d0ffbe6e803f tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (448b03ce-18cf-44f2-bfe4-c4d1e10dae02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-99b19938-fcf4-4fee-9331-d0ffbe6e803f tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf34861-db56-4b43-8987-0ecb0bbf7325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:36 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-99b19938-fcf4-4fee-9331-d0ffbe6e803f tempest-VolumesActionsTest-1099538795 None] Volume cae558d6-ca0b-4939-82ef-c1f86908c649: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cae558d6-ca0b-4939-82ef-c1f86908c649', 'volume_size': 1}
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-99b19938-fcf4-4fee-9331-d0ffbe6e803f tempest-VolumesActionsTest-1099538795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:36 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-6862206b-6ca9-49d5-807b-b1b82d7f680c tempest-GroupSnapshotsTest-773077248 None] group_snapshot fa2fa128-9144-4645-af1c-e8374ea36d7c: deleting
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-6862206b-6ca9-49d5-807b-b1b82d7f680c tempest-GroupSnapshotsTest-773077248 None] group_snapshot fa2fa128-9144-4645-af1c-e8374ea36d7c: deleting {{(pid=82102) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-6862206b-6ca9-49d5-807b-b1b82d7f680c tempest-GroupSnapshotsTest-773077248 None] Acquiring lock "cinder-quobyte-b1784ccc-d470-4bb2-b340-5ffc2187c97a" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-6862206b-6ca9-49d5-807b-b1b82d7f680c tempest-GroupSnapshotsTest-773077248 None] Lock "cinder-quobyte-b1784ccc-d470-4bb2-b340-5ffc2187c97a" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-6862206b-6ca9-49d5-807b-b1b82d7f680c tempest-GroupSnapshotsTest-773077248 None] Acquiring lock "cinder-quobyte-678d95b9-46b9-43a0-bc04-8ac61cd0c335" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-6862206b-6ca9-49d5-807b-b1b82d7f680c tempest-GroupSnapshotsTest-773077248 None] Lock "cinder-quobyte-678d95b9-46b9-43a0-bc04-8ac61cd0c335" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-6862206b-6ca9-49d5-807b-b1b82d7f680c tempest-GroupSnapshotsTest-773077248 None] Deleting offline snapshot 678d95b9-46b9-43a0-bc04-8ac61cd0c335 of volume b1784ccc-d470-4bb2-b340-5ffc2187c97a {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-6862206b-6ca9-49d5-807b-b1b82d7f680c tempest-GroupSnapshotsTest-773077248 None] snapshot_file for this snap is: volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a.678d95b9-46b9-43a0-bc04-8ac61cd0c335 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a84f59e0-929c-476e-9d4a-32156281a098 tempest-CreateVolumesFromImageTest-77586842 None] Acquiring lock "cinder-dcc0c23f-789e-4f00-9c30-e85c928accb0-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a84f59e0-929c-476e-9d4a-32156281a098 tempest-CreateVolumesFromImageTest-77586842 None] Lock "cinder-dcc0c23f-789e-4f00-9c30-e85c928accb0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c597156-ed52-447c-882a-06e41fa338f3]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6862206b-6ca9-49d5-807b-b1b82d7f680c tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a.678d95b9-46b9-43a0-bc04-8ac61cd0c335 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:36 devstack sudo[87235]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-93c4c4a6-fa6e-4a53-a08f-311d8d2f7481 tempest-VolumesListTestJSON-1077070625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b4120049-eff3-42f1-a03d-1114a69fb25c 1073741824" returned: 0 in 0.617s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-93c4c4a6-fa6e-4a53-a08f-311d8d2f7481 tempest-VolumesListTestJSON-1077070625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b4120049-eff3-42f1-a03d-1114a69fb25c {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a84f59e0-929c-476e-9d4a-32156281a098 tempest-CreateVolumesFromImageTest-77586842 None] Acquiring lock "cinder-quobyte-dcc0c23f-789e-4f00-9c30-e85c928accb0" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:36 devstack sudo[87241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b4120049-eff3-42f1-a03d-1114a69fb25c
Apr 02 10:29:36 devstack sudo[87241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a84f59e0-929c-476e-9d4a-32156281a098 tempest-CreateVolumesFromImageTest-77586842 None] Lock "cinder-quobyte-dcc0c23f-789e-4f00-9c30-e85c928accb0" acquired by "delete_volume" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:36 devstack sudo[87240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a.678d95b9-46b9-43a0-bc04-8ac61cd0c335
Apr 02 10:29:36 devstack sudo[87240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[790bf605-9d53-4a69-9ea5-ef7c749dc759]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:29:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a84f59e0-929c-476e-9d4a-32156281a098 tempest-CreateVolumesFromImageTest-77586842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-dcc0c23f-789e-4f00-9c30-e85c928accb0 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:36 devstack sudo[87244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-dcc0c23f-789e-4f00-9c30-e85c928accb0
Apr 02 10:29:36 devstack sudo[87244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:37 devstack sudo[87241]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-93c4c4a6-fa6e-4a53-a08f-311d8d2f7481 tempest-VolumesListTestJSON-1077070625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b4120049-eff3-42f1-a03d-1114a69fb25c" returned: 0 in 0.453s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:37 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-93c4c4a6-fa6e-4a53-a08f-311d8d2f7481 tempest-VolumesListTestJSON-1077070625 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:29:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-93c4c4a6-fa6e-4a53-a08f-311d8d2f7481 tempest-VolumesListTestJSON-1077070625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:37 devstack sudo[87240]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-99b19938-fcf4-4fee-9331-d0ffbe6e803f tempest-VolumesActionsTest-1099538795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.758s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:37 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-99b19938-fcf4-4fee-9331-d0ffbe6e803f tempest-VolumesActionsTest-1099538795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-309001720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cae558d6-ca0b-4939-82ef-c1f86908c649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92cd48ebe8bf4c4d8acbf4c15968d823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:36Z,use_quota=True,user_id='1e0b000a1a39462998b46dd57ca6b695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:29:37 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-99b19938-fcf4-4fee-9331-d0ffbe6e803f tempest-VolumesActionsTest-1099538795 None] Creating volume cae558d6-ca0b-4939-82ef-c1f86908c649 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:29:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-99b19938-fcf4-4fee-9331-d0ffbe6e803f tempest-VolumesActionsTest-1099538795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-99b19938-fcf4-4fee-9331-d0ffbe6e803f tempest-VolumesActionsTest-1099538795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:37 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-99b19938-fcf4-4fee-9331-d0ffbe6e803f tempest-VolumesActionsTest-1099538795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:37 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-99b19938-fcf4-4fee-9331-d0ffbe6e803f tempest-VolumesActionsTest-1099538795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-99b19938-fcf4-4fee-9331-d0ffbe6e803f tempest-VolumesActionsTest-1099538795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:37 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-99b19938-fcf4-4fee-9331-d0ffbe6e803f tempest-VolumesActionsTest-1099538795 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:29:37 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-99b19938-fcf4-4fee-9331-d0ffbe6e803f tempest-VolumesActionsTest-1099538795 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:29:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-99b19938-fcf4-4fee-9331-d0ffbe6e803f tempest-VolumesActionsTest-1099538795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-cae558d6-ca0b-4939-82ef-c1f86908c649 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6862206b-6ca9-49d5-807b-b1b82d7f680c tempest-GroupSnapshotsTest-773077248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a.678d95b9-46b9-43a0-bc04-8ac61cd0c335" returned: 0 in 0.539s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:37 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-93c4c4a6-fa6e-4a53-a08f-311d8d2f7481 tempest-VolumesListTestJSON-1077070625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (236488d7-c116-45f3-bc18-09d5a6465d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4120049-eff3-42f1-a03d-1114a69fb25c', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:37 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-93c4c4a6-fa6e-4a53-a08f-311d8d2f7481 tempest-VolumesListTestJSON-1077070625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1653053d-feec-463e-8133-8fc9b32ad534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:37 devstack sudo[87253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-cae558d6-ca0b-4939-82ef-c1f86908c649 1073741824
Apr 02 10:29:37 devstack sudo[87253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:37 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-6862206b-6ca9-49d5-807b-b1b82d7f680c tempest-GroupSnapshotsTest-773077248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:29:37 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-93c4c4a6-fa6e-4a53-a08f-311d8d2f7481 tempest-VolumesListTestJSON-1077070625 None] Volume volume-b4120049-eff3-42f1-a03d-1114a69fb25c (b4120049-eff3-42f1-a03d-1114a69fb25c): created successfully
Apr 02 10:29:37 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-93c4c4a6-fa6e-4a53-a08f-311d8d2f7481 tempest-VolumesListTestJSON-1077070625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1653053d-feec-463e-8133-8fc9b32ad534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:37 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-93c4c4a6-fa6e-4a53-a08f-311d8d2f7481 tempest-VolumesListTestJSON-1077070625 None] Flow 'volume_create_manager' (127d70b4-1c8f-43ff-800f-3582f49c7cab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:37 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a94fff-c283-4e35-980a-6fcea506c636]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:29:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6862206b-6ca9-49d5-807b-b1b82d7f680c tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:37 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-93c4c4a6-fa6e-4a53-a08f-311d8d2f7481 tempest-VolumesListTestJSON-1077070625 None] Created volume successfully.
Apr 02 10:29:37 devstack sudo[87244]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a84f59e0-929c-476e-9d4a-32156281a098 tempest-CreateVolumesFromImageTest-77586842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-dcc0c23f-789e-4f00-9c30-e85c928accb0" returned: 0 in 0.510s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a84f59e0-929c-476e-9d4a-32156281a098 tempest-CreateVolumesFromImageTest-77586842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-dcc0c23f-789e-4f00-9c30-e85c928accb0 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:37 devstack sudo[87256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-dcc0c23f-789e-4f00-9c30-e85c928accb0
Apr 02 10:29:37 devstack sudo[87256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:37 devstack sudo[87255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a
Apr 02 10:29:37 devstack sudo[87255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:37 devstack sudo[87253]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-99b19938-fcf4-4fee-9331-d0ffbe6e803f tempest-VolumesActionsTest-1099538795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-cae558d6-ca0b-4939-82ef-c1f86908c649 1073741824" returned: 0 in 0.577s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:37 devstack sudo[87256]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a84f59e0-929c-476e-9d4a-32156281a098 tempest-CreateVolumesFromImageTest-77586842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-dcc0c23f-789e-4f00-9c30-e85c928accb0" returned: 0 in 0.512s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-99b19938-fcf4-4fee-9331-d0ffbe6e803f tempest-VolumesActionsTest-1099538795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-cae558d6-ca0b-4939-82ef-c1f86908c649 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:37 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a84f59e0-929c-476e-9d4a-32156281a098 tempest-CreateVolumesFromImageTest-77586842 None] Lock "cinder-quobyte-dcc0c23f-789e-4f00-9c30-e85c928accb0" released by "delete_volume" :: held 1.059s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:37 devstack sudo[87266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-cae558d6-ca0b-4939-82ef-c1f86908c649
Apr 02 10:29:37 devstack sudo[87266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:37 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-a84f59e0-929c-476e-9d4a-32156281a098 tempest-CreateVolumesFromImageTest-77586842 None] Created reservations ['5fbd4099-9008-43ba-8567-8b25fcf8dc12', '7ceffbc0-cffb-4b74-b3ad-0fe2c59b8e80', 'b97c4924-e698-4a35-81bd-932e43230ff4', '55303bf4-9249-4f18-a6fd-7b05af9a841a'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:29:37 devstack sudo[87255]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6862206b-6ca9-49d5-807b-b1b82d7f680c tempest-GroupSnapshotsTest-773077248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a" returned: 0 in 0.612s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6862206b-6ca9-49d5-807b-b1b82d7f680c tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a.678d95b9-46b9-43a0-bc04-8ac61cd0c335 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:37 devstack sudo[87268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a.678d95b9-46b9-43a0-bc04-8ac61cd0c335
Apr 02 10:29:37 devstack sudo[87268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a84f59e0-929c-476e-9d4a-32156281a098 tempest-CreateVolumesFromImageTest-77586842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a84f59e0-929c-476e-9d4a-32156281a098 tempest-CreateVolumesFromImageTest-77586842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:37 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-a84f59e0-929c-476e-9d4a-32156281a098 tempest-CreateVolumesFromImageTest-77586842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:37 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-a84f59e0-929c-476e-9d4a-32156281a098 tempest-CreateVolumesFromImageTest-77586842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a84f59e0-929c-476e-9d4a-32156281a098 tempest-CreateVolumesFromImageTest-77586842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a84f59e0-929c-476e-9d4a-32156281a098 tempest-CreateVolumesFromImageTest-77586842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:37 devstack sudo[87270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:29:37 devstack sudo[87270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:38 devstack sudo[87266]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-99b19938-fcf4-4fee-9331-d0ffbe6e803f tempest-VolumesActionsTest-1099538795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-cae558d6-ca0b-4939-82ef-c1f86908c649" returned: 0 in 0.520s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-99b19938-fcf4-4fee-9331-d0ffbe6e803f tempest-VolumesActionsTest-1099538795 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-99b19938-fcf4-4fee-9331-d0ffbe6e803f tempest-VolumesActionsTest-1099538795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-99b19938-fcf4-4fee-9331-d0ffbe6e803f tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf34861-db56-4b43-8987-0ecb0bbf7325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cae558d6-ca0b-4939-82ef-c1f86908c649', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-99b19938-fcf4-4fee-9331-d0ffbe6e803f tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (948a018c-cb37-4612-8dcd-524c343b9584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:38 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-99b19938-fcf4-4fee-9331-d0ffbe6e803f tempest-VolumesActionsTest-1099538795 None] Volume volume-cae558d6-ca0b-4939-82ef-c1f86908c649 (cae558d6-ca0b-4939-82ef-c1f86908c649): created successfully
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-99b19938-fcf4-4fee-9331-d0ffbe6e803f tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (948a018c-cb37-4612-8dcd-524c343b9584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-99b19938-fcf4-4fee-9331-d0ffbe6e803f tempest-VolumesActionsTest-1099538795 None] Flow 'volume_create_manager' (707098eb-5250-4466-830d-9f9ee28e827a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:38 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-99b19938-fcf4-4fee-9331-d0ffbe6e803f tempest-VolumesActionsTest-1099538795 None] Created volume successfully.
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-06a27efe-5e55-4628-9960-305e16c13b0c tempest-VolumesListTestJSON-1077070625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:29:38 devstack sudo[87270]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:38 devstack sudo[87268]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-06a27efe-5e55-4628-9960-305e16c13b0c tempest-VolumesListTestJSON-1077070625 None] Flow 'volume_create_manager' (8161cbec-874a-47a6-8329-3415ee32fbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-06a27efe-5e55-4628-9960-305e16c13b0c tempest-VolumesListTestJSON-1077070625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5820820-7465-44d3-81ca-481a54faafb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6862206b-6ca9-49d5-807b-b1b82d7f680c tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a.678d95b9-46b9-43a0-bc04-8ac61cd0c335" returned: 0 in 0.605s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a84f59e0-929c-476e-9d4a-32156281a098 tempest-CreateVolumesFromImageTest-77586842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.545s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6862206b-6ca9-49d5-807b-b1b82d7f680c tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a.678d95b9-46b9-43a0-bc04-8ac61cd0c335 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-a84f59e0-929c-476e-9d4a-32156281a098 tempest-CreateVolumesFromImageTest-77586842 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:29:38 devstack sudo[87277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a.678d95b9-46b9-43a0-bc04-8ac61cd0c335
Apr 02 10:29:38 devstack sudo[87277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-06a27efe-5e55-4628-9960-305e16c13b0c tempest-VolumesListTestJSON-1077070625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5820820-7465-44d3-81ca-481a54faafb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1009153792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=668066a8-97c2-4ef8-8518-55675a364ee4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8f07de7cd6d4c22905c9cf27baa288b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:38Z,use_quota=True,user_id='7bb79b698c464abca3587a66b293ea13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-06a27efe-5e55-4628-9960-305e16c13b0c tempest-VolumesListTestJSON-1077070625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b974fc6-dff1-4f71-9b88-7bbaae6ae167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-06a27efe-5e55-4628-9960-305e16c13b0c tempest-VolumesListTestJSON-1077070625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b974fc6-dff1-4f71-9b88-7bbaae6ae167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-06a27efe-5e55-4628-9960-305e16c13b0c tempest-VolumesListTestJSON-1077070625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e15526db-0eec-41c5-98fb-620108f45856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-06a27efe-5e55-4628-9960-305e16c13b0c tempest-VolumesListTestJSON-1077070625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e15526db-0eec-41c5-98fb-620108f45856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '668066a8-97c2-4ef8-8518-55675a364ee4', 'volume_name': 'volume-668066a8-97c2-4ef8-8518-55675a364ee4', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-06a27efe-5e55-4628-9960-305e16c13b0c tempest-VolumesListTestJSON-1077070625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3739226-70b6-42e0-b8a2-8d4752875e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-06a27efe-5e55-4628-9960-305e16c13b0c tempest-VolumesListTestJSON-1077070625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3739226-70b6-42e0-b8a2-8d4752875e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-06a27efe-5e55-4628-9960-305e16c13b0c tempest-VolumesListTestJSON-1077070625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e64f1250-6dc4-4c01-a467-b43c213c801c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:38 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-06a27efe-5e55-4628-9960-305e16c13b0c tempest-VolumesListTestJSON-1077070625 None] Volume 668066a8-97c2-4ef8-8518-55675a364ee4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-668066a8-97c2-4ef8-8518-55675a364ee4', 'volume_size': 1}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-06a27efe-5e55-4628-9960-305e16c13b0c tempest-VolumesListTestJSON-1077070625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-06a27efe-5e55-4628-9960-305e16c13b0c tempest-VolumesListTestJSON-1077070625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-06a27efe-5e55-4628-9960-305e16c13b0c tempest-VolumesListTestJSON-1077070625 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1009153792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=668066a8-97c2-4ef8-8518-55675a364ee4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8f07de7cd6d4c22905c9cf27baa288b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:38Z,use_quota=True,user_id='7bb79b698c464abca3587a66b293ea13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-06a27efe-5e55-4628-9960-305e16c13b0c tempest-VolumesListTestJSON-1077070625 None] Creating volume 668066a8-97c2-4ef8-8518-55675a364ee4 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-06a27efe-5e55-4628-9960-305e16c13b0c tempest-VolumesListTestJSON-1077070625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-06a27efe-5e55-4628-9960-305e16c13b0c tempest-VolumesListTestJSON-1077070625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-06a27efe-5e55-4628-9960-305e16c13b0c tempest-VolumesListTestJSON-1077070625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-06a27efe-5e55-4628-9960-305e16c13b0c tempest-VolumesListTestJSON-1077070625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-06a27efe-5e55-4628-9960-305e16c13b0c tempest-VolumesListTestJSON-1077070625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-06a27efe-5e55-4628-9960-305e16c13b0c tempest-VolumesListTestJSON-1077070625 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:29:38 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-06a27efe-5e55-4628-9960-305e16c13b0c tempest-VolumesListTestJSON-1077070625 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-06a27efe-5e55-4628-9960-305e16c13b0c tempest-VolumesListTestJSON-1077070625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-668066a8-97c2-4ef8-8518-55675a364ee4 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:38 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-a84f59e0-929c-476e-9d4a-32156281a098 tempest-CreateVolumesFromImageTest-77586842 None] Deleted volume successfully.
Apr 02 10:29:38 devstack sudo[87279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-668066a8-97c2-4ef8-8518-55675a364ee4 1073741824
Apr 02 10:29:38 devstack sudo[87279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a84f59e0-929c-476e-9d4a-32156281a098 tempest-CreateVolumesFromImageTest-77586842 None] Lock "cinder-dcc0c23f-789e-4f00-9c30-e85c928accb0-delete_volume" released by "delete_volume" :: held 1.898s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-8868547c-d9ff-4cb4-a682-d4936dbe5657 tempest-VolumesActionsTest-2043573547 None] Acquiring lock "cinder-cae558d6-ca0b-4939-82ef-c1f86908c649-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-8868547c-d9ff-4cb4-a682-d4936dbe5657 tempest-VolumesActionsTest-2043573547 None] Lock "cinder-cae558d6-ca0b-4939-82ef-c1f86908c649-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-8868547c-d9ff-4cb4-a682-d4936dbe5657 tempest-VolumesActionsTest-2043573547 None] Acquiring lock "cinder-quobyte-cae558d6-ca0b-4939-82ef-c1f86908c649" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-8868547c-d9ff-4cb4-a682-d4936dbe5657 tempest-VolumesActionsTest-2043573547 None] Lock "cinder-quobyte-cae558d6-ca0b-4939-82ef-c1f86908c649" acquired by "delete_volume" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05b2d29-b9a5-449b-aee2-ba6c936af74d]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8868547c-d9ff-4cb4-a682-d4936dbe5657 tempest-VolumesActionsTest-2043573547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-cae558d6-ca0b-4939-82ef-c1f86908c649 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:38 devstack sudo[87281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-cae558d6-ca0b-4939-82ef-c1f86908c649
Apr 02 10:29:38 devstack sudo[87281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f4469ae5-62dc-466e-a480-6e8b5db39d48 tempest-CreateVolumesFromImageTest-77586842 None] Acquiring lock "cinder-b6658969-3360-4db9-ad43-20b5595e34df-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f4469ae5-62dc-466e-a480-6e8b5db39d48 tempest-CreateVolumesFromImageTest-77586842 None] Lock "cinder-b6658969-3360-4db9-ad43-20b5595e34df-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f4469ae5-62dc-466e-a480-6e8b5db39d48 tempest-CreateVolumesFromImageTest-77586842 None] Acquiring lock "cinder-quobyte-b6658969-3360-4db9-ad43-20b5595e34df" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f4469ae5-62dc-466e-a480-6e8b5db39d48 tempest-CreateVolumesFromImageTest-77586842 None] Lock "cinder-quobyte-b6658969-3360-4db9-ad43-20b5595e34df" acquired by "delete_volume" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[97273d1d-60d3-4d5e-99d0-bd8a7e73dda4]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:29:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f4469ae5-62dc-466e-a480-6e8b5db39d48 tempest-CreateVolumesFromImageTest-77586842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b6658969-3360-4db9-ad43-20b5595e34df {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:39 devstack sudo[87277]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6862206b-6ca9-49d5-807b-b1b82d7f680c tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a.678d95b9-46b9-43a0-bc04-8ac61cd0c335" returned: 0 in 0.529s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:39 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-6862206b-6ca9-49d5-807b-b1b82d7f680c tempest-GroupSnapshotsTest-773077248 None] Lock "cinder-quobyte-678d95b9-46b9-43a0-bc04-8ac61cd0c335" released by "_delete_snapshot" :: held 2.403s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:39 devstack sudo[87287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b6658969-3360-4db9-ad43-20b5595e34df
Apr 02 10:29:39 devstack sudo[87287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:39 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-6862206b-6ca9-49d5-807b-b1b82d7f680c tempest-GroupSnapshotsTest-773077248 None] Lock "cinder-quobyte-b1784ccc-d470-4bb2-b340-5ffc2187c97a" released by "delete_snapshot" :: held 2.417s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:39 devstack cinder-volume[82102]: WARNING cinder.quota [None req-6862206b-6ca9-49d5-807b-b1b82d7f680c tempest-GroupSnapshotsTest-773077248 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1298974449 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1298974449, it is now deprecated. Please use the default quota class for default quota.
Apr 02 10:29:39 devstack cinder-volume[82102]: WARNING cinder.quota [None req-6862206b-6ca9-49d5-807b-b1b82d7f680c tempest-GroupSnapshotsTest-773077248 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1298974449 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1298974449, it is now deprecated. Please use the default quota class for default quota.
Apr 02 10:29:39 devstack sudo[87279]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:39 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-6862206b-6ca9-49d5-807b-b1b82d7f680c tempest-GroupSnapshotsTest-773077248 None] Created reservations ['4ba97aca-0ef1-4a04-9028-5506bd84544f', '26216f22-9d4d-4182-9bdd-b2d8b150e7fa', '681e9e75-b86e-497a-ace3-a8c168b9bbb8', '8dd89ce5-c866-4612-a9ba-9dfaa07077fe'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:29:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-06a27efe-5e55-4628-9960-305e16c13b0c tempest-VolumesListTestJSON-1077070625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-668066a8-97c2-4ef8-8518-55675a364ee4 1073741824" returned: 0 in 0.562s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-06a27efe-5e55-4628-9960-305e16c13b0c tempest-VolumesListTestJSON-1077070625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-668066a8-97c2-4ef8-8518-55675a364ee4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:39 devstack sudo[87289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-668066a8-97c2-4ef8-8518-55675a364ee4
Apr 02 10:29:39 devstack sudo[87289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:39 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-6862206b-6ca9-49d5-807b-b1b82d7f680c tempest-GroupSnapshotsTest-773077248 None] group_snapshot fa2fa128-9144-4645-af1c-e8374ea36d7c: deleted successfully
Apr 02 10:29:39 devstack sudo[87281]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8868547c-d9ff-4cb4-a682-d4936dbe5657 tempest-VolumesActionsTest-2043573547 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-cae558d6-ca0b-4939-82ef-c1f86908c649" returned: 0 in 0.569s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8868547c-d9ff-4cb4-a682-d4936dbe5657 tempest-VolumesActionsTest-2043573547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-cae558d6-ca0b-4939-82ef-c1f86908c649 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:39 devstack sudo[87294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-cae558d6-ca0b-4939-82ef-c1f86908c649
Apr 02 10:29:39 devstack sudo[87294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:39 devstack sudo[87287]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f4469ae5-62dc-466e-a480-6e8b5db39d48 tempest-CreateVolumesFromImageTest-77586842 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b6658969-3360-4db9-ad43-20b5595e34df" returned: 0 in 0.563s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f4469ae5-62dc-466e-a480-6e8b5db39d48 tempest-CreateVolumesFromImageTest-77586842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b6658969-3360-4db9-ad43-20b5595e34df {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:39 devstack sudo[87300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b6658969-3360-4db9-ad43-20b5595e34df
Apr 02 10:29:39 devstack sudo[87300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:39 devstack sudo[87289]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-06a27efe-5e55-4628-9960-305e16c13b0c tempest-VolumesListTestJSON-1077070625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-668066a8-97c2-4ef8-8518-55675a364ee4" returned: 0 in 0.453s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:39 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-06a27efe-5e55-4628-9960-305e16c13b0c tempest-VolumesListTestJSON-1077070625 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:29:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-06a27efe-5e55-4628-9960-305e16c13b0c tempest-VolumesListTestJSON-1077070625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:39 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-06a27efe-5e55-4628-9960-305e16c13b0c tempest-VolumesListTestJSON-1077070625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e64f1250-6dc4-4c01-a467-b43c213c801c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-668066a8-97c2-4ef8-8518-55675a364ee4', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:39 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-06a27efe-5e55-4628-9960-305e16c13b0c tempest-VolumesListTestJSON-1077070625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (515839ee-1a52-479d-b4b4-3f822136486b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:39 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-06a27efe-5e55-4628-9960-305e16c13b0c tempest-VolumesListTestJSON-1077070625 None] Volume volume-668066a8-97c2-4ef8-8518-55675a364ee4 (668066a8-97c2-4ef8-8518-55675a364ee4): created successfully
Apr 02 10:29:39 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-06a27efe-5e55-4628-9960-305e16c13b0c tempest-VolumesListTestJSON-1077070625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (515839ee-1a52-479d-b4b4-3f822136486b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:39 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-06a27efe-5e55-4628-9960-305e16c13b0c tempest-VolumesListTestJSON-1077070625 None] Flow 'volume_create_manager' (8161cbec-874a-47a6-8329-3415ee32fbe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:39 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-06a27efe-5e55-4628-9960-305e16c13b0c tempest-VolumesListTestJSON-1077070625 None] Created volume successfully.
Apr 02 10:29:39 devstack sudo[87294]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8868547c-d9ff-4cb4-a682-d4936dbe5657 tempest-VolumesActionsTest-2043573547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-cae558d6-ca0b-4939-82ef-c1f86908c649" returned: 0 in 0.436s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:39 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-8868547c-d9ff-4cb4-a682-d4936dbe5657 tempest-VolumesActionsTest-2043573547 None] Lock "cinder-quobyte-cae558d6-ca0b-4939-82ef-c1f86908c649" released by "delete_volume" :: held 1.041s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:39 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-8868547c-d9ff-4cb4-a682-d4936dbe5657 tempest-VolumesActionsTest-2043573547 None] Created reservations ['1422e602-5a59-42b5-8dcf-1f90c7c2d059', '7b023f16-1e64-40d6-8bda-f1c49134ce3b', '6b83b393-4072-499e-832e-d7e7e087719f', '70c4c8f6-eb99-4006-8537-1587f6ef42b5'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:29:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8868547c-d9ff-4cb4-a682-d4936dbe5657 tempest-VolumesActionsTest-2043573547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8868547c-d9ff-4cb4-a682-d4936dbe5657 tempest-VolumesActionsTest-2043573547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:39 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8868547c-d9ff-4cb4-a682-d4936dbe5657 tempest-VolumesActionsTest-2043573547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:39 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8868547c-d9ff-4cb4-a682-d4936dbe5657 tempest-VolumesActionsTest-2043573547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8868547c-d9ff-4cb4-a682-d4936dbe5657 tempest-VolumesActionsTest-2043573547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8868547c-d9ff-4cb4-a682-d4936dbe5657 tempest-VolumesActionsTest-2043573547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:39 devstack sudo[87303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:29:39 devstack sudo[87303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:39 devstack sudo[87300]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f4469ae5-62dc-466e-a480-6e8b5db39d48 tempest-CreateVolumesFromImageTest-77586842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b6658969-3360-4db9-ad43-20b5595e34df" returned: 0 in 0.441s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:39 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f4469ae5-62dc-466e-a480-6e8b5db39d48 tempest-CreateVolumesFromImageTest-77586842 None] Lock "cinder-quobyte-b6658969-3360-4db9-ad43-20b5595e34df" released by "delete_volume" :: held 1.036s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-f4469ae5-62dc-466e-a480-6e8b5db39d48 tempest-CreateVolumesFromImageTest-77586842 None] Created reservations ['2b472f47-1c54-44e8-bb53-c8289433f58f', '5809d173-139e-4c20-b479-6a49245ecf60', '3e3196ae-d61c-4258-ac8d-fd4ad278ac6f', 'ca0f0304-f58c-4f4a-8db1-019ef642491a'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-32a6d9b4-5394-4d01-ac56-d927f0de5012 tempest-GroupSnapshotsTest-773077248 None] Acquiring lock "cinder-quobyte-b1784ccc-d470-4bb2-b340-5ffc2187c97a" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-32a6d9b4-5394-4d01-ac56-d927f0de5012 tempest-GroupSnapshotsTest-773077248 None] Lock "cinder-quobyte-b1784ccc-d470-4bb2-b340-5ffc2187c97a" acquired by "delete_volume" :: waited 0.012s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[694a6489-7a74-4b17-801f-ed6d87a9080d]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-32a6d9b4-5394-4d01-ac56-d927f0de5012 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f4469ae5-62dc-466e-a480-6e8b5db39d48 tempest-CreateVolumesFromImageTest-77586842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f4469ae5-62dc-466e-a480-6e8b5db39d48 tempest-CreateVolumesFromImageTest-77586842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f4469ae5-62dc-466e-a480-6e8b5db39d48 tempest-CreateVolumesFromImageTest-77586842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f4469ae5-62dc-466e-a480-6e8b5db39d48 tempest-CreateVolumesFromImageTest-77586842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f4469ae5-62dc-466e-a480-6e8b5db39d48 tempest-CreateVolumesFromImageTest-77586842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f4469ae5-62dc-466e-a480-6e8b5db39d48 tempest-CreateVolumesFromImageTest-77586842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:40 devstack sudo[87307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:29:40 devstack sudo[87307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:40 devstack sudo[87306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a
Apr 02 10:29:40 devstack sudo[87306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:40 devstack sudo[87303]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8868547c-d9ff-4cb4-a682-d4936dbe5657 tempest-VolumesActionsTest-2043573547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.479s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-8868547c-d9ff-4cb4-a682-d4936dbe5657 tempest-VolumesActionsTest-2043573547 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:29:40 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-8868547c-d9ff-4cb4-a682-d4936dbe5657 tempest-VolumesActionsTest-2043573547 None] Deleted volume successfully.
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-8868547c-d9ff-4cb4-a682-d4936dbe5657 tempest-VolumesActionsTest-2043573547 None] Lock "cinder-cae558d6-ca0b-4939-82ef-c1f86908c649-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:40 devstack sudo[87307]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f4469ae5-62dc-466e-a480-6e8b5db39d48 tempest-CreateVolumesFromImageTest-77586842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.444s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-f4469ae5-62dc-466e-a480-6e8b5db39d48 tempest-CreateVolumesFromImageTest-77586842 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:29:40 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-f4469ae5-62dc-466e-a480-6e8b5db39d48 tempest-CreateVolumesFromImageTest-77586842 None] Deleted volume successfully.
Apr 02 10:29:40 devstack sudo[87306]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-32a6d9b4-5394-4d01-ac56-d927f0de5012 tempest-GroupSnapshotsTest-773077248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a" returned: 0 in 0.497s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-32a6d9b4-5394-4d01-ac56-d927f0de5012 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f4469ae5-62dc-466e-a480-6e8b5db39d48 tempest-CreateVolumesFromImageTest-77586842 None] Lock "cinder-b6658969-3360-4db9-ad43-20b5595e34df-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:40 devstack sudo[87315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a
Apr 02 10:29:40 devstack sudo[87315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-db62c94e-4e8f-4511-b3cb-827e48187f4a tempest-VolumesListTestJSON-1077070625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-db62c94e-4e8f-4511-b3cb-827e48187f4a tempest-VolumesListTestJSON-1077070625 None] Flow 'volume_create_manager' (c9a023e5-a1c0-4fa3-81b6-ae9258f5706e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-db62c94e-4e8f-4511-b3cb-827e48187f4a tempest-VolumesListTestJSON-1077070625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8395ae3a-abcf-4a9b-8890-665fef69018d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-db62c94e-4e8f-4511-b3cb-827e48187f4a tempest-VolumesListTestJSON-1077070625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8395ae3a-abcf-4a9b-8890-665fef69018d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-239845909',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3caf4708-59ae-4d33-8405-dd844578abb0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8f07de7cd6d4c22905c9cf27baa288b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:41Z,use_quota=True,user_id='7bb79b698c464abca3587a66b293ea13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-db62c94e-4e8f-4511-b3cb-827e48187f4a tempest-VolumesListTestJSON-1077070625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0f4bacc-2835-4a07-ba28-2bf98ae69ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-db62c94e-4e8f-4511-b3cb-827e48187f4a tempest-VolumesListTestJSON-1077070625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0f4bacc-2835-4a07-ba28-2bf98ae69ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-db62c94e-4e8f-4511-b3cb-827e48187f4a tempest-VolumesListTestJSON-1077070625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8121c44-1164-4e33-8362-ae26d17bccc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-db62c94e-4e8f-4511-b3cb-827e48187f4a tempest-VolumesListTestJSON-1077070625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8121c44-1164-4e33-8362-ae26d17bccc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3caf4708-59ae-4d33-8405-dd844578abb0', 'volume_name': 'volume-3caf4708-59ae-4d33-8405-dd844578abb0', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-db62c94e-4e8f-4511-b3cb-827e48187f4a tempest-VolumesListTestJSON-1077070625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12736100-4cdd-44cf-9b52-4a7046528d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-db62c94e-4e8f-4511-b3cb-827e48187f4a tempest-VolumesListTestJSON-1077070625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12736100-4cdd-44cf-9b52-4a7046528d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-db62c94e-4e8f-4511-b3cb-827e48187f4a tempest-VolumesListTestJSON-1077070625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31840bb4-75ff-478a-be31-9a197ea826af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:40 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-db62c94e-4e8f-4511-b3cb-827e48187f4a tempest-VolumesListTestJSON-1077070625 None] Volume 3caf4708-59ae-4d33-8405-dd844578abb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3caf4708-59ae-4d33-8405-dd844578abb0', 'volume_size': 1}
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-db62c94e-4e8f-4511-b3cb-827e48187f4a tempest-VolumesListTestJSON-1077070625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-db62c94e-4e8f-4511-b3cb-827e48187f4a tempest-VolumesListTestJSON-1077070625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-db62c94e-4e8f-4511-b3cb-827e48187f4a tempest-VolumesListTestJSON-1077070625 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-239845909',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3caf4708-59ae-4d33-8405-dd844578abb0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8f07de7cd6d4c22905c9cf27baa288b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:41Z,use_quota=True,user_id='7bb79b698c464abca3587a66b293ea13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-db62c94e-4e8f-4511-b3cb-827e48187f4a tempest-VolumesListTestJSON-1077070625 None] Creating volume 3caf4708-59ae-4d33-8405-dd844578abb0 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-db62c94e-4e8f-4511-b3cb-827e48187f4a tempest-VolumesListTestJSON-1077070625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-db62c94e-4e8f-4511-b3cb-827e48187f4a tempest-VolumesListTestJSON-1077070625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:40 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-db62c94e-4e8f-4511-b3cb-827e48187f4a tempest-VolumesListTestJSON-1077070625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:41 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-db62c94e-4e8f-4511-b3cb-827e48187f4a tempest-VolumesListTestJSON-1077070625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-db62c94e-4e8f-4511-b3cb-827e48187f4a tempest-VolumesListTestJSON-1077070625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:41 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-db62c94e-4e8f-4511-b3cb-827e48187f4a tempest-VolumesListTestJSON-1077070625 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:29:41 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-db62c94e-4e8f-4511-b3cb-827e48187f4a tempest-VolumesListTestJSON-1077070625 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:29:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-db62c94e-4e8f-4511-b3cb-827e48187f4a tempest-VolumesListTestJSON-1077070625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3caf4708-59ae-4d33-8405-dd844578abb0 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:41 devstack sudo[87325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3caf4708-59ae-4d33-8405-dd844578abb0 1073741824
Apr 02 10:29:41 devstack sudo[87325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:41 devstack sudo[87315]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-32a6d9b4-5394-4d01-ac56-d927f0de5012 tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b1784ccc-d470-4bb2-b340-5ffc2187c97a" returned: 0 in 0.449s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:41 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-32a6d9b4-5394-4d01-ac56-d927f0de5012 tempest-GroupSnapshotsTest-773077248 None] Lock "cinder-quobyte-b1784ccc-d470-4bb2-b340-5ffc2187c97a" released by "delete_volume" :: held 0.981s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:41 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-32a6d9b4-5394-4d01-ac56-d927f0de5012 tempest-GroupSnapshotsTest-773077248 None] Created reservations ['b4a96973-cf4b-4165-9891-90763a6e8932'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:29:41 devstack cinder-volume[82102]: WARNING cinder.quota [None req-32a6d9b4-5394-4d01-ac56-d927f0de5012 tempest-GroupSnapshotsTest-773077248 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1298974449 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1298974449, it is now deprecated. Please use the default quota class for default quota.
Apr 02 10:29:41 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-32a6d9b4-5394-4d01-ac56-d927f0de5012 tempest-GroupSnapshotsTest-773077248 None] Created reservations ['e6974db6-c47e-4f44-bc28-ddd7f2a74d30', '33d5e751-83b2-43b9-91c9-a419edc567ff', '10da9497-e086-4315-b257-fa7477385980', '6327e423-1ff4-42c3-8a9d-df5dd27ce619'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:29:41 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1ad5676-128c-45eb-b0bd-eb64218ea5f5 tempest-VolumesActionsTest-1099538795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:29:41 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b1ad5676-128c-45eb-b0bd-eb64218ea5f5 tempest-VolumesActionsTest-1099538795 None] Flow 'volume_create_manager' (56b3c861-1889-4020-b726-3dc63de69f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:41 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b1ad5676-128c-45eb-b0bd-eb64218ea5f5 tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (952d4df2-2a8e-4d1f-936a-b3e9230170be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:41 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b1ad5676-128c-45eb-b0bd-eb64218ea5f5 tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (952d4df2-2a8e-4d1f-936a-b3e9230170be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-691811695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=801e70a6-9698-454d-8438-e89ce5179da4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92cd48ebe8bf4c4d8acbf4c15968d823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:41Z,use_quota=True,user_id='1e0b000a1a39462998b46dd57ca6b695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:41 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b1ad5676-128c-45eb-b0bd-eb64218ea5f5 tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63e405f3-ec45-4f2e-b089-7dad83f0fc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:41 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b1ad5676-128c-45eb-b0bd-eb64218ea5f5 tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63e405f3-ec45-4f2e-b089-7dad83f0fc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:41 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b1ad5676-128c-45eb-b0bd-eb64218ea5f5 tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a1c505-e7a4-4ebc-b79f-fb4f08570e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:41 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b1ad5676-128c-45eb-b0bd-eb64218ea5f5 tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a1c505-e7a4-4ebc-b79f-fb4f08570e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '801e70a6-9698-454d-8438-e89ce5179da4', 'volume_name': 'volume-801e70a6-9698-454d-8438-e89ce5179da4', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:41 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b1ad5676-128c-45eb-b0bd-eb64218ea5f5 tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (639e7cea-0f17-4ce3-9fab-c4ba47948251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:41 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b1ad5676-128c-45eb-b0bd-eb64218ea5f5 tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (639e7cea-0f17-4ce3-9fab-c4ba47948251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:41 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b1ad5676-128c-45eb-b0bd-eb64218ea5f5 tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e2b99cb-f6b8-438c-8539-56646ab8d09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:41 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-b1ad5676-128c-45eb-b0bd-eb64218ea5f5 tempest-VolumesActionsTest-1099538795 None] Volume 801e70a6-9698-454d-8438-e89ce5179da4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-801e70a6-9698-454d-8438-e89ce5179da4', 'volume_size': 1}
Apr 02 10:29:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-b1ad5676-128c-45eb-b0bd-eb64218ea5f5 tempest-VolumesActionsTest-1099538795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-32a6d9b4-5394-4d01-ac56-d927f0de5012 tempest-GroupSnapshotsTest-773077248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-32a6d9b4-5394-4d01-ac56-d927f0de5012 tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:41 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-32a6d9b4-5394-4d01-ac56-d927f0de5012 tempest-GroupSnapshotsTest-773077248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:41 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-32a6d9b4-5394-4d01-ac56-d927f0de5012 tempest-GroupSnapshotsTest-773077248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-32a6d9b4-5394-4d01-ac56-d927f0de5012 tempest-GroupSnapshotsTest-773077248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-32a6d9b4-5394-4d01-ac56-d927f0de5012 tempest-GroupSnapshotsTest-773077248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:41 devstack sudo[87327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:29:41 devstack sudo[87327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:41 devstack sudo[87325]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-db62c94e-4e8f-4511-b3cb-827e48187f4a tempest-VolumesListTestJSON-1077070625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3caf4708-59ae-4d33-8405-dd844578abb0 1073741824" returned: 0 in 0.654s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-db62c94e-4e8f-4511-b3cb-827e48187f4a tempest-VolumesListTestJSON-1077070625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3caf4708-59ae-4d33-8405-dd844578abb0 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:41 devstack sudo[87332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3caf4708-59ae-4d33-8405-dd844578abb0
Apr 02 10:29:41 devstack sudo[87332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:41 devstack sudo[87327]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-32a6d9b4-5394-4d01-ac56-d927f0de5012 tempest-GroupSnapshotsTest-773077248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.499s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:41 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-32a6d9b4-5394-4d01-ac56-d927f0de5012 tempest-GroupSnapshotsTest-773077248 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:29:41 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-32a6d9b4-5394-4d01-ac56-d927f0de5012 tempest-GroupSnapshotsTest-773077248 None] Delete group completed successfully.
Apr 02 10:29:42 devstack sudo[87332]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-db62c94e-4e8f-4511-b3cb-827e48187f4a tempest-VolumesListTestJSON-1077070625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3caf4708-59ae-4d33-8405-dd844578abb0" returned: 0 in 0.471s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:42 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-db62c94e-4e8f-4511-b3cb-827e48187f4a tempest-VolumesListTestJSON-1077070625 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:29:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-db62c94e-4e8f-4511-b3cb-827e48187f4a tempest-VolumesListTestJSON-1077070625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-b1ad5676-128c-45eb-b0bd-eb64218ea5f5 tempest-VolumesActionsTest-1099538795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.849s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:42 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-b1ad5676-128c-45eb-b0bd-eb64218ea5f5 tempest-VolumesActionsTest-1099538795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-691811695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=801e70a6-9698-454d-8438-e89ce5179da4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92cd48ebe8bf4c4d8acbf4c15968d823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:41Z,use_quota=True,user_id='1e0b000a1a39462998b46dd57ca6b695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:29:42 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-b1ad5676-128c-45eb-b0bd-eb64218ea5f5 tempest-VolumesActionsTest-1099538795 None] Creating volume 801e70a6-9698-454d-8438-e89ce5179da4 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:29:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-b1ad5676-128c-45eb-b0bd-eb64218ea5f5 tempest-VolumesActionsTest-1099538795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-b1ad5676-128c-45eb-b0bd-eb64218ea5f5 tempest-VolumesActionsTest-1099538795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:42 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-b1ad5676-128c-45eb-b0bd-eb64218ea5f5 tempest-VolumesActionsTest-1099538795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:42 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-b1ad5676-128c-45eb-b0bd-eb64218ea5f5 tempest-VolumesActionsTest-1099538795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-b1ad5676-128c-45eb-b0bd-eb64218ea5f5 tempest-VolumesActionsTest-1099538795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:42 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-b1ad5676-128c-45eb-b0bd-eb64218ea5f5 tempest-VolumesActionsTest-1099538795 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:29:42 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-b1ad5676-128c-45eb-b0bd-eb64218ea5f5 tempest-VolumesActionsTest-1099538795 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:29:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b1ad5676-128c-45eb-b0bd-eb64218ea5f5 tempest-VolumesActionsTest-1099538795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-801e70a6-9698-454d-8438-e89ce5179da4 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:42 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-db62c94e-4e8f-4511-b3cb-827e48187f4a tempest-VolumesListTestJSON-1077070625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31840bb4-75ff-478a-be31-9a197ea826af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3caf4708-59ae-4d33-8405-dd844578abb0', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:42 devstack sudo[87336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-801e70a6-9698-454d-8438-e89ce5179da4 1073741824
Apr 02 10:29:42 devstack sudo[87336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:42 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-db62c94e-4e8f-4511-b3cb-827e48187f4a tempest-VolumesListTestJSON-1077070625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (254bf588-7e70-4768-8116-1da742249aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:42 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-db62c94e-4e8f-4511-b3cb-827e48187f4a tempest-VolumesListTestJSON-1077070625 None] Volume volume-3caf4708-59ae-4d33-8405-dd844578abb0 (3caf4708-59ae-4d33-8405-dd844578abb0): created successfully
Apr 02 10:29:42 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-db62c94e-4e8f-4511-b3cb-827e48187f4a tempest-VolumesListTestJSON-1077070625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (254bf588-7e70-4768-8116-1da742249aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:42 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-db62c94e-4e8f-4511-b3cb-827e48187f4a tempest-VolumesListTestJSON-1077070625 None] Flow 'volume_create_manager' (c9a023e5-a1c0-4fa3-81b6-ae9258f5706e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:42 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-db62c94e-4e8f-4511-b3cb-827e48187f4a tempest-VolumesListTestJSON-1077070625 None] Created volume successfully.
Apr 02 10:29:42 devstack sudo[87336]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b1ad5676-128c-45eb-b0bd-eb64218ea5f5 tempest-VolumesActionsTest-1099538795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-801e70a6-9698-454d-8438-e89ce5179da4 1073741824" returned: 0 in 0.599s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b1ad5676-128c-45eb-b0bd-eb64218ea5f5 tempest-VolumesActionsTest-1099538795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-801e70a6-9698-454d-8438-e89ce5179da4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:42 devstack sudo[87341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-801e70a6-9698-454d-8438-e89ce5179da4
Apr 02 10:29:42 devstack sudo[87341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:43 devstack sudo[87341]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b1ad5676-128c-45eb-b0bd-eb64218ea5f5 tempest-VolumesActionsTest-1099538795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-801e70a6-9698-454d-8438-e89ce5179da4" returned: 0 in 0.461s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:43 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-b1ad5676-128c-45eb-b0bd-eb64218ea5f5 tempest-VolumesActionsTest-1099538795 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:29:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-b1ad5676-128c-45eb-b0bd-eb64218ea5f5 tempest-VolumesActionsTest-1099538795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:43 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b1ad5676-128c-45eb-b0bd-eb64218ea5f5 tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e2b99cb-f6b8-438c-8539-56646ab8d09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-801e70a6-9698-454d-8438-e89ce5179da4', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:43 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b1ad5676-128c-45eb-b0bd-eb64218ea5f5 tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1519b70b-88ac-4a49-bb76-cf5eb68096be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:43 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-b1ad5676-128c-45eb-b0bd-eb64218ea5f5 tempest-VolumesActionsTest-1099538795 None] Volume volume-801e70a6-9698-454d-8438-e89ce5179da4 (801e70a6-9698-454d-8438-e89ce5179da4): created successfully
Apr 02 10:29:43 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b1ad5676-128c-45eb-b0bd-eb64218ea5f5 tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1519b70b-88ac-4a49-bb76-cf5eb68096be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:43 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b1ad5676-128c-45eb-b0bd-eb64218ea5f5 tempest-VolumesActionsTest-1099538795 None] Flow 'volume_create_manager' (56b3c861-1889-4020-b726-3dc63de69f28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:43 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-b1ad5676-128c-45eb-b0bd-eb64218ea5f5 tempest-VolumesActionsTest-1099538795 None] Created volume successfully.
Apr 02 10:29:43 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5ffcd5bd-5124-4d41-9107-fde796f04559 tempest-VolumesActionsTest-2043573547 None] Acquiring lock "cinder-801e70a6-9698-454d-8438-e89ce5179da4-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:43 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5ffcd5bd-5124-4d41-9107-fde796f04559 tempest-VolumesActionsTest-2043573547 None] Lock "cinder-801e70a6-9698-454d-8438-e89ce5179da4-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:43 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5ffcd5bd-5124-4d41-9107-fde796f04559 tempest-VolumesActionsTest-2043573547 None] Acquiring lock "cinder-quobyte-801e70a6-9698-454d-8438-e89ce5179da4" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:43 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5ffcd5bd-5124-4d41-9107-fde796f04559 tempest-VolumesActionsTest-2043573547 None] Lock "cinder-quobyte-801e70a6-9698-454d-8438-e89ce5179da4" acquired by "delete_volume" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:43 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbfbd64-218e-45ba-9423-d11c0ab293af]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:29:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5ffcd5bd-5124-4d41-9107-fde796f04559 tempest-VolumesActionsTest-2043573547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-801e70a6-9698-454d-8438-e89ce5179da4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:43 devstack sudo[87344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-801e70a6-9698-454d-8438-e89ce5179da4
Apr 02 10:29:43 devstack sudo[87344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:44 devstack sudo[87344]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:44 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5ffcd5bd-5124-4d41-9107-fde796f04559 tempest-VolumesActionsTest-2043573547 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-801e70a6-9698-454d-8438-e89ce5179da4" returned: 0 in 0.609s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:44 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5ffcd5bd-5124-4d41-9107-fde796f04559 tempest-VolumesActionsTest-2043573547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-801e70a6-9698-454d-8438-e89ce5179da4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:44 devstack sudo[87349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-801e70a6-9698-454d-8438-e89ce5179da4
Apr 02 10:29:44 devstack sudo[87349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:45 devstack sudo[87349]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5ffcd5bd-5124-4d41-9107-fde796f04559 tempest-VolumesActionsTest-2043573547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-801e70a6-9698-454d-8438-e89ce5179da4" returned: 0 in 0.579s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:45 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5ffcd5bd-5124-4d41-9107-fde796f04559 tempest-VolumesActionsTest-2043573547 None] Lock "cinder-quobyte-801e70a6-9698-454d-8438-e89ce5179da4" released by "delete_volume" :: held 1.217s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:45 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-5ffcd5bd-5124-4d41-9107-fde796f04559 tempest-VolumesActionsTest-2043573547 None] Created reservations ['51d9f513-1842-478c-8e99-42635e0ccd15', '1f57146f-a0ed-4732-98c4-335c079f8966', 'ef3b5718-6905-4222-a9ff-e281a6bdd121', 'd6a3d641-988c-4dfd-8fa4-b2a0c7a1c6da'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:29:45 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3d6db85c-2fc6-4247-9fac-44455963d730 tempest-VolumesListTestJSON-1077070625 None] Acquiring lock "cinder-3caf4708-59ae-4d33-8405-dd844578abb0-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:45 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3d6db85c-2fc6-4247-9fac-44455963d730 tempest-VolumesListTestJSON-1077070625 None] Lock "cinder-3caf4708-59ae-4d33-8405-dd844578abb0-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5ffcd5bd-5124-4d41-9107-fde796f04559 tempest-VolumesActionsTest-2043573547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5ffcd5bd-5124-4d41-9107-fde796f04559 tempest-VolumesActionsTest-2043573547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:45 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5ffcd5bd-5124-4d41-9107-fde796f04559 tempest-VolumesActionsTest-2043573547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:45 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5ffcd5bd-5124-4d41-9107-fde796f04559 tempest-VolumesActionsTest-2043573547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5ffcd5bd-5124-4d41-9107-fde796f04559 tempest-VolumesActionsTest-2043573547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5ffcd5bd-5124-4d41-9107-fde796f04559 tempest-VolumesActionsTest-2043573547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:45 devstack sudo[87352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:29:45 devstack sudo[87352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:45 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3d6db85c-2fc6-4247-9fac-44455963d730 tempest-VolumesListTestJSON-1077070625 None] Acquiring lock "cinder-quobyte-3caf4708-59ae-4d33-8405-dd844578abb0" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:45 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3d6db85c-2fc6-4247-9fac-44455963d730 tempest-VolumesListTestJSON-1077070625 None] Lock "cinder-quobyte-3caf4708-59ae-4d33-8405-dd844578abb0" acquired by "delete_volume" :: waited 0.012s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:45 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[51732238-1334-43e4-9ea4-4b4d281ad7bd]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:29:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3d6db85c-2fc6-4247-9fac-44455963d730 tempest-VolumesListTestJSON-1077070625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3caf4708-59ae-4d33-8405-dd844578abb0 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:45 devstack sudo[87354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3caf4708-59ae-4d33-8405-dd844578abb0
Apr 02 10:29:45 devstack sudo[87354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:45 devstack sudo[87352]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5ffcd5bd-5124-4d41-9107-fde796f04559 tempest-VolumesActionsTest-2043573547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.539s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:45 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-5ffcd5bd-5124-4d41-9107-fde796f04559 tempest-VolumesActionsTest-2043573547 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:29:45 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-5ffcd5bd-5124-4d41-9107-fde796f04559 tempest-VolumesActionsTest-2043573547 None] Deleted volume successfully.
Apr 02 10:29:45 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5ffcd5bd-5124-4d41-9107-fde796f04559 tempest-VolumesActionsTest-2043573547 None] Lock "cinder-801e70a6-9698-454d-8438-e89ce5179da4-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:45 devstack sudo[87354]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:45 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-989b16f8-f27e-4683-8900-4428196b66df tempest-GroupsTest-303820755 None] Group tempest-Group1-1842400097: creating
Apr 02 10:29:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3d6db85c-2fc6-4247-9fac-44455963d730 tempest-VolumesListTestJSON-1077070625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3caf4708-59ae-4d33-8405-dd844578abb0" returned: 0 in 0.620s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3d6db85c-2fc6-4247-9fac-44455963d730 tempest-VolumesListTestJSON-1077070625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3caf4708-59ae-4d33-8405-dd844578abb0 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:45 devstack sudo[87360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3caf4708-59ae-4d33-8405-dd844578abb0
Apr 02 10:29:45 devstack sudo[87360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:45 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-989b16f8-f27e-4683-8900-4428196b66df tempest-GroupsTest-303820755 None] Group tempest-Group1-1842400097: created successfully
Apr 02 10:29:45 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-989b16f8-f27e-4683-8900-4428196b66df tempest-GroupsTest-303820755 None] Create group completed successfully.
Apr 02 10:29:46 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-045098c3-4f0a-40ae-8abe-28b027c01b99 tempest-VolumesActionsTest-1099538795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:29:46 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-045098c3-4f0a-40ae-8abe-28b027c01b99 tempest-VolumesActionsTest-1099538795 None] Flow 'volume_create_manager' (c00f146d-36d3-42ba-96ee-a2843196a9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:46 devstack sudo[87360]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:46 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-045098c3-4f0a-40ae-8abe-28b027c01b99 tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce749acc-5ee8-4d8f-be5f-938c83181bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:46 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3d6db85c-2fc6-4247-9fac-44455963d730 tempest-VolumesListTestJSON-1077070625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3caf4708-59ae-4d33-8405-dd844578abb0" returned: 0 in 0.476s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:46 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-045098c3-4f0a-40ae-8abe-28b027c01b99 tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce749acc-5ee8-4d8f-be5f-938c83181bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2068305173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b15d2558-2a6e-4e80-a651-c3cd7e702337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92cd48ebe8bf4c4d8acbf4c15968d823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:46Z,use_quota=True,user_id='1e0b000a1a39462998b46dd57ca6b695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:46 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-045098c3-4f0a-40ae-8abe-28b027c01b99 tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e282db4-4f04-4f25-bcbc-e68042eec56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:46 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-045098c3-4f0a-40ae-8abe-28b027c01b99 tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e282db4-4f04-4f25-bcbc-e68042eec56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:46 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-045098c3-4f0a-40ae-8abe-28b027c01b99 tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ba47da3-0490-4be8-8dc6-ec3e29e260f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:46 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-045098c3-4f0a-40ae-8abe-28b027c01b99 tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ba47da3-0490-4be8-8dc6-ec3e29e260f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b15d2558-2a6e-4e80-a651-c3cd7e702337', 'volume_name': 'volume-b15d2558-2a6e-4e80-a651-c3cd7e702337', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:46 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-045098c3-4f0a-40ae-8abe-28b027c01b99 tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba98996a-a119-4f2b-98c1-b53d160851f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:46 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-045098c3-4f0a-40ae-8abe-28b027c01b99 tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba98996a-a119-4f2b-98c1-b53d160851f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:46 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-045098c3-4f0a-40ae-8abe-28b027c01b99 tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f79cace-8cd7-4019-ad58-28d42eb99899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:46 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-045098c3-4f0a-40ae-8abe-28b027c01b99 tempest-VolumesActionsTest-1099538795 None] Volume b15d2558-2a6e-4e80-a651-c3cd7e702337: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b15d2558-2a6e-4e80-a651-c3cd7e702337', 'volume_size': 1}
Apr 02 10:29:46 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-045098c3-4f0a-40ae-8abe-28b027c01b99 tempest-VolumesActionsTest-1099538795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:46 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-045098c3-4f0a-40ae-8abe-28b027c01b99 tempest-VolumesActionsTest-1099538795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:46 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-045098c3-4f0a-40ae-8abe-28b027c01b99 tempest-VolumesActionsTest-1099538795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2068305173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b15d2558-2a6e-4e80-a651-c3cd7e702337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92cd48ebe8bf4c4d8acbf4c15968d823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:46Z,use_quota=True,user_id='1e0b000a1a39462998b46dd57ca6b695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:29:46 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-045098c3-4f0a-40ae-8abe-28b027c01b99 tempest-VolumesActionsTest-1099538795 None] Creating volume b15d2558-2a6e-4e80-a651-c3cd7e702337 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:29:46 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-045098c3-4f0a-40ae-8abe-28b027c01b99 tempest-VolumesActionsTest-1099538795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:46 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-045098c3-4f0a-40ae-8abe-28b027c01b99 tempest-VolumesActionsTest-1099538795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:46 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-045098c3-4f0a-40ae-8abe-28b027c01b99 tempest-VolumesActionsTest-1099538795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:46 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-045098c3-4f0a-40ae-8abe-28b027c01b99 tempest-VolumesActionsTest-1099538795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:46 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-045098c3-4f0a-40ae-8abe-28b027c01b99 tempest-VolumesActionsTest-1099538795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:46 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-045098c3-4f0a-40ae-8abe-28b027c01b99 tempest-VolumesActionsTest-1099538795 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:29:46 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-045098c3-4f0a-40ae-8abe-28b027c01b99 tempest-VolumesActionsTest-1099538795 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:29:46 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-045098c3-4f0a-40ae-8abe-28b027c01b99 tempest-VolumesActionsTest-1099538795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b15d2558-2a6e-4e80-a651-c3cd7e702337 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:46 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3d6db85c-2fc6-4247-9fac-44455963d730 tempest-VolumesListTestJSON-1077070625 None] Lock "cinder-quobyte-3caf4708-59ae-4d33-8405-dd844578abb0" released by "delete_volume" :: held 1.179s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:46 devstack sudo[87363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b15d2558-2a6e-4e80-a651-c3cd7e702337 1073741824
Apr 02 10:29:46 devstack sudo[87363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:46 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-3d6db85c-2fc6-4247-9fac-44455963d730 tempest-VolumesListTestJSON-1077070625 None] Created reservations ['c05e9d57-9ee9-47fa-98d9-522f91eb502a', '165cf439-5d9c-4fec-896d-b04494e6dd1c', '72ffa7b9-cff7-4f70-b86c-649efa31839a', 'f94f262a-e7a5-4c5a-b6cc-5a9162d77e28'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:29:46 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3d6db85c-2fc6-4247-9fac-44455963d730 tempest-VolumesListTestJSON-1077070625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:46 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3d6db85c-2fc6-4247-9fac-44455963d730 tempest-VolumesListTestJSON-1077070625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:46 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3d6db85c-2fc6-4247-9fac-44455963d730 tempest-VolumesListTestJSON-1077070625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:46 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3d6db85c-2fc6-4247-9fac-44455963d730 tempest-VolumesListTestJSON-1077070625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:46 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3d6db85c-2fc6-4247-9fac-44455963d730 tempest-VolumesListTestJSON-1077070625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:46 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3d6db85c-2fc6-4247-9fac-44455963d730 tempest-VolumesListTestJSON-1077070625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:46 devstack sudo[87365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:29:46 devstack sudo[87365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:46 devstack sudo[87363]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:46 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-045098c3-4f0a-40ae-8abe-28b027c01b99 tempest-VolumesActionsTest-1099538795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b15d2558-2a6e-4e80-a651-c3cd7e702337 1073741824" returned: 0 in 0.576s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:47 devstack sudo[87365]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3d6db85c-2fc6-4247-9fac-44455963d730 tempest-VolumesListTestJSON-1077070625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.498s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:47 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-3d6db85c-2fc6-4247-9fac-44455963d730 tempest-VolumesListTestJSON-1077070625 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:29:47 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-3d6db85c-2fc6-4247-9fac-44455963d730 tempest-VolumesListTestJSON-1077070625 None] Deleted volume successfully.
Apr 02 10:29:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-045098c3-4f0a-40ae-8abe-28b027c01b99 tempest-VolumesActionsTest-1099538795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b15d2558-2a6e-4e80-a651-c3cd7e702337 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:47 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3d6db85c-2fc6-4247-9fac-44455963d730 tempest-VolumesListTestJSON-1077070625 None] Lock "cinder-3caf4708-59ae-4d33-8405-dd844578abb0-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:47 devstack sudo[87371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b15d2558-2a6e-4e80-a651-c3cd7e702337
Apr 02 10:29:47 devstack sudo[87371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:47 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-5a236ca9-3a59-4dc1-b76d-9713a781aad3 tempest-GroupsTest-303820755 None] Group tempest-Group2-384340206: creating
Apr 02 10:29:47 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-5a236ca9-3a59-4dc1-b76d-9713a781aad3 tempest-GroupsTest-303820755 None] Group tempest-Group2-384340206: created successfully
Apr 02 10:29:47 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-5a236ca9-3a59-4dc1-b76d-9713a781aad3 tempest-GroupsTest-303820755 None] Create group completed successfully.
Apr 02 10:29:47 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-35d5e037-60be-4823-a369-f3f73fac2d99 tempest-VolumesListTestJSON-1077070625 None] Acquiring lock "cinder-668066a8-97c2-4ef8-8518-55675a364ee4-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:47 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-35d5e037-60be-4823-a369-f3f73fac2d99 tempest-VolumesListTestJSON-1077070625 None] Lock "cinder-668066a8-97c2-4ef8-8518-55675a364ee4-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:47 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-35d5e037-60be-4823-a369-f3f73fac2d99 tempest-VolumesListTestJSON-1077070625 None] Acquiring lock "cinder-quobyte-668066a8-97c2-4ef8-8518-55675a364ee4" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:47 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-35d5e037-60be-4823-a369-f3f73fac2d99 tempest-VolumesListTestJSON-1077070625 None] Lock "cinder-quobyte-668066a8-97c2-4ef8-8518-55675a364ee4" acquired by "delete_volume" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:47 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3506b7ce-1811-41bb-baae-698c85eddeb5]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:29:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-35d5e037-60be-4823-a369-f3f73fac2d99 tempest-VolumesListTestJSON-1077070625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-668066a8-97c2-4ef8-8518-55675a364ee4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:47 devstack sudo[87371]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-045098c3-4f0a-40ae-8abe-28b027c01b99 tempest-VolumesActionsTest-1099538795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b15d2558-2a6e-4e80-a651-c3cd7e702337" returned: 0 in 0.460s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:47 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-045098c3-4f0a-40ae-8abe-28b027c01b99 tempest-VolumesActionsTest-1099538795 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:29:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-045098c3-4f0a-40ae-8abe-28b027c01b99 tempest-VolumesActionsTest-1099538795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:47 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-045098c3-4f0a-40ae-8abe-28b027c01b99 tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f79cace-8cd7-4019-ad58-28d42eb99899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b15d2558-2a6e-4e80-a651-c3cd7e702337', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:47 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-045098c3-4f0a-40ae-8abe-28b027c01b99 tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b0bc96-89f1-468c-a709-ac007e387d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:47 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-045098c3-4f0a-40ae-8abe-28b027c01b99 tempest-VolumesActionsTest-1099538795 None] Volume volume-b15d2558-2a6e-4e80-a651-c3cd7e702337 (b15d2558-2a6e-4e80-a651-c3cd7e702337): created successfully
Apr 02 10:29:47 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-045098c3-4f0a-40ae-8abe-28b027c01b99 tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b0bc96-89f1-468c-a709-ac007e387d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:47 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-045098c3-4f0a-40ae-8abe-28b027c01b99 tempest-VolumesActionsTest-1099538795 None] Flow 'volume_create_manager' (c00f146d-36d3-42ba-96ee-a2843196a9e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:47 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-045098c3-4f0a-40ae-8abe-28b027c01b99 tempest-VolumesActionsTest-1099538795 None] Created volume successfully.
Apr 02 10:29:47 devstack sudo[87408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-668066a8-97c2-4ef8-8518-55675a364ee4
Apr 02 10:29:47 devstack sudo[87408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:47 devstack sudo[87408]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-35d5e037-60be-4823-a369-f3f73fac2d99 tempest-VolumesListTestJSON-1077070625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-668066a8-97c2-4ef8-8518-55675a364ee4" returned: 0 in 0.463s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-35d5e037-60be-4823-a369-f3f73fac2d99 tempest-VolumesListTestJSON-1077070625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-668066a8-97c2-4ef8-8518-55675a364ee4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:47 devstack sudo[87413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-668066a8-97c2-4ef8-8518-55675a364ee4
Apr 02 10:29:47 devstack sudo[87413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:48 devstack sudo[87413]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-35d5e037-60be-4823-a369-f3f73fac2d99 tempest-VolumesListTestJSON-1077070625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-668066a8-97c2-4ef8-8518-55675a364ee4" returned: 0 in 0.408s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-35d5e037-60be-4823-a369-f3f73fac2d99 tempest-VolumesListTestJSON-1077070625 None] Lock "cinder-quobyte-668066a8-97c2-4ef8-8518-55675a364ee4" released by "delete_volume" :: held 0.901s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-35d5e037-60be-4823-a369-f3f73fac2d99 tempest-VolumesListTestJSON-1077070625 None] Created reservations ['d10a17b2-8382-4f8a-8c3b-66d5b35d6d02', 'fc689f40-3c66-4492-8c45-aedf8d6175a8', '1f1f79b8-0261-4086-affd-030aaec2ce5d', 'be45bd81-b623-400d-8073-4784279b4441'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-35d5e037-60be-4823-a369-f3f73fac2d99 tempest-VolumesListTestJSON-1077070625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-35d5e037-60be-4823-a369-f3f73fac2d99 tempest-VolumesListTestJSON-1077070625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-35d5e037-60be-4823-a369-f3f73fac2d99 tempest-VolumesListTestJSON-1077070625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-35d5e037-60be-4823-a369-f3f73fac2d99 tempest-VolumesListTestJSON-1077070625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-35d5e037-60be-4823-a369-f3f73fac2d99 tempest-VolumesListTestJSON-1077070625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-35d5e037-60be-4823-a369-f3f73fac2d99 tempest-VolumesListTestJSON-1077070625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:48 devstack sudo[87416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:29:48 devstack sudo[87416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1e4be74-ff34-4eb3-bc29-aabf6c1d1478 tempest-GroupsTest-303820755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b1e4be74-ff34-4eb3-bc29-aabf6c1d1478 tempest-GroupsTest-303820755 None] Flow 'volume_create_manager' (cfc153bf-25e8-4239-9dd8-c6cbf7604869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b1e4be74-ff34-4eb3-bc29-aabf6c1d1478 tempest-GroupsTest-303820755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e632dac-4d28-449f-bdd0-69c0213f1fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b1e4be74-ff34-4eb3-bc29-aabf6c1d1478 tempest-GroupsTest-303820755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e632dac-4d28-449f-bdd0-69c0213f1fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-455689062',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8634651c-e4e3-49e0-b95f-32b45fe058ad,host='devstack@QuobyteHD#QuobyteHD',id=1d09a212-809c-4b41-8ade-10131801ed5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3e8fa7494b473c9621c99d272f55a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:48Z,use_quota=True,user_id='2cab7f12c1be4724aee57975c8e853b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cb6f5c3-e232-4616-9cb3-437c0455c53d),volume_type_id=0cb6f5c3-e232-4616-9cb3-437c0455c53d)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b1e4be74-ff34-4eb3-bc29-aabf6c1d1478 tempest-GroupsTest-303820755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c913ec-221e-41cf-b6d3-6a64ec379db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b1e4be74-ff34-4eb3-bc29-aabf6c1d1478 tempest-GroupsTest-303820755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c913ec-221e-41cf-b6d3-6a64ec379db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b1e4be74-ff34-4eb3-bc29-aabf6c1d1478 tempest-GroupsTest-303820755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8acf72fb-92c9-44b1-99da-2a68aab0ac1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b1e4be74-ff34-4eb3-bc29-aabf6c1d1478 tempest-GroupsTest-303820755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8acf72fb-92c9-44b1-99da-2a68aab0ac1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d09a212-809c-4b41-8ade-10131801ed5b', 'volume_name': 'volume-1d09a212-809c-4b41-8ade-10131801ed5b', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b1e4be74-ff34-4eb3-bc29-aabf6c1d1478 tempest-GroupsTest-303820755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83524d92-9d8c-4109-97ec-43fb9db84ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b1e4be74-ff34-4eb3-bc29-aabf6c1d1478 tempest-GroupsTest-303820755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83524d92-9d8c-4109-97ec-43fb9db84ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b1e4be74-ff34-4eb3-bc29-aabf6c1d1478 tempest-GroupsTest-303820755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f5b115e-3f17-4296-96dc-f919dfdc6a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:48 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-b1e4be74-ff34-4eb3-bc29-aabf6c1d1478 tempest-GroupsTest-303820755 None] Volume 1d09a212-809c-4b41-8ade-10131801ed5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d09a212-809c-4b41-8ade-10131801ed5b', 'volume_size': 1}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-b1e4be74-ff34-4eb3-bc29-aabf6c1d1478 tempest-GroupsTest-303820755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-b1e4be74-ff34-4eb3-bc29-aabf6c1d1478 tempest-GroupsTest-303820755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-b1e4be74-ff34-4eb3-bc29-aabf6c1d1478 tempest-GroupsTest-303820755 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8634651c-e4e3-49e0-b95f-32b45fe058ad,created_at=2026-04-02T08:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-455689062',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8634651c-e4e3-49e0-b95f-32b45fe058ad,host='devstack@QuobyteHD#QuobyteHD',id=1d09a212-809c-4b41-8ade-10131801ed5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3e8fa7494b473c9621c99d272f55a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:48Z,use_quota=True,user_id='2cab7f12c1be4724aee57975c8e853b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cb6f5c3-e232-4616-9cb3-437c0455c53d),volume_type_id=0cb6f5c3-e232-4616-9cb3-437c0455c53d)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-b1e4be74-ff34-4eb3-bc29-aabf6c1d1478 tempest-GroupsTest-303820755 None] Creating volume 1d09a212-809c-4b41-8ade-10131801ed5b {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-b1e4be74-ff34-4eb3-bc29-aabf6c1d1478 tempest-GroupsTest-303820755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-b1e4be74-ff34-4eb3-bc29-aabf6c1d1478 tempest-GroupsTest-303820755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-b1e4be74-ff34-4eb3-bc29-aabf6c1d1478 tempest-GroupsTest-303820755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-b1e4be74-ff34-4eb3-bc29-aabf6c1d1478 tempest-GroupsTest-303820755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-b1e4be74-ff34-4eb3-bc29-aabf6c1d1478 tempest-GroupsTest-303820755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-b1e4be74-ff34-4eb3-bc29-aabf6c1d1478 tempest-GroupsTest-303820755 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:29:48 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-b1e4be74-ff34-4eb3-bc29-aabf6c1d1478 tempest-GroupsTest-303820755 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b1e4be74-ff34-4eb3-bc29-aabf6c1d1478 tempest-GroupsTest-303820755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-1d09a212-809c-4b41-8ade-10131801ed5b 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-aa59e768-c9e1-4086-9819-0e4a794388fa tempest-VolumesActionsTest-2043573547 None] Acquiring lock "cinder-b15d2558-2a6e-4e80-a651-c3cd7e702337-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-16ead920-7b70-4c87-97ad-143f0d3457b6 tempest-VolumesListTestJSON-1077070625 None] Acquiring lock "cinder-b4120049-eff3-42f1-a03d-1114a69fb25c-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-aa59e768-c9e1-4086-9819-0e4a794388fa tempest-VolumesActionsTest-2043573547 None] Lock "cinder-b15d2558-2a6e-4e80-a651-c3cd7e702337-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:48 devstack sudo[87418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-1d09a212-809c-4b41-8ade-10131801ed5b 1073741824
Apr 02 10:29:48 devstack sudo[87418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-16ead920-7b70-4c87-97ad-143f0d3457b6 tempest-VolumesListTestJSON-1077070625 None] Lock "cinder-b4120049-eff3-42f1-a03d-1114a69fb25c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-16ead920-7b70-4c87-97ad-143f0d3457b6 tempest-VolumesListTestJSON-1077070625 None] Acquiring lock "cinder-quobyte-b4120049-eff3-42f1-a03d-1114a69fb25c" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-aa59e768-c9e1-4086-9819-0e4a794388fa tempest-VolumesActionsTest-2043573547 None] Acquiring lock "cinder-quobyte-b15d2558-2a6e-4e80-a651-c3cd7e702337" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-16ead920-7b70-4c87-97ad-143f0d3457b6 tempest-VolumesListTestJSON-1077070625 None] Lock "cinder-quobyte-b4120049-eff3-42f1-a03d-1114a69fb25c" acquired by "delete_volume" :: waited 0.019s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-aa59e768-c9e1-4086-9819-0e4a794388fa tempest-VolumesActionsTest-2043573547 None] Lock "cinder-quobyte-b15d2558-2a6e-4e80-a651-c3cd7e702337" acquired by "delete_volume" :: waited 0.015s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[81df6f2e-87ea-4f8c-982d-b2953dfd4104]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-16ead920-7b70-4c87-97ad-143f0d3457b6 tempest-VolumesListTestJSON-1077070625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b4120049-eff3-42f1-a03d-1114a69fb25c {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0075d2-4baf-424e-90f4-e0628db3ec28]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-aa59e768-c9e1-4086-9819-0e4a794388fa tempest-VolumesActionsTest-2043573547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b15d2558-2a6e-4e80-a651-c3cd7e702337 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:48 devstack sudo[87421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b4120049-eff3-42f1-a03d-1114a69fb25c
Apr 02 10:29:48 devstack sudo[87421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:48 devstack sudo[87422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b15d2558-2a6e-4e80-a651-c3cd7e702337
Apr 02 10:29:48 devstack sudo[87422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:48 devstack sudo[87416]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-35d5e037-60be-4823-a369-f3f73fac2d99 tempest-VolumesListTestJSON-1077070625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.494s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-35d5e037-60be-4823-a369-f3f73fac2d99 tempest-VolumesListTestJSON-1077070625 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:29:48 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-35d5e037-60be-4823-a369-f3f73fac2d99 tempest-VolumesListTestJSON-1077070625 None] Deleted volume successfully.
Apr 02 10:29:48 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-35d5e037-60be-4823-a369-f3f73fac2d99 tempest-VolumesListTestJSON-1077070625 None] Lock "cinder-668066a8-97c2-4ef8-8518-55675a364ee4-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:49 devstack sudo[87418]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b1e4be74-ff34-4eb3-bc29-aabf6c1d1478 tempest-GroupsTest-303820755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-1d09a212-809c-4b41-8ade-10131801ed5b 1073741824" returned: 0 in 0.556s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b1e4be74-ff34-4eb3-bc29-aabf6c1d1478 tempest-GroupsTest-303820755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-1d09a212-809c-4b41-8ade-10131801ed5b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:49 devstack sudo[87435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-1d09a212-809c-4b41-8ade-10131801ed5b
Apr 02 10:29:49 devstack sudo[87435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:49 devstack sudo[87421]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-16ead920-7b70-4c87-97ad-143f0d3457b6 tempest-VolumesListTestJSON-1077070625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b4120049-eff3-42f1-a03d-1114a69fb25c" returned: 0 in 0.504s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-16ead920-7b70-4c87-97ad-143f0d3457b6 tempest-VolumesListTestJSON-1077070625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b4120049-eff3-42f1-a03d-1114a69fb25c {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:49 devstack sudo[87422]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:49 devstack sudo[87437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b4120049-eff3-42f1-a03d-1114a69fb25c
Apr 02 10:29:49 devstack sudo[87437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-aa59e768-c9e1-4086-9819-0e4a794388fa tempest-VolumesActionsTest-2043573547 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b15d2558-2a6e-4e80-a651-c3cd7e702337" returned: 0 in 0.515s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-aa59e768-c9e1-4086-9819-0e4a794388fa tempest-VolumesActionsTest-2043573547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b15d2558-2a6e-4e80-a651-c3cd7e702337 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:49 devstack sudo[87439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b15d2558-2a6e-4e80-a651-c3cd7e702337
Apr 02 10:29:49 devstack sudo[87439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:49 devstack sudo[87435]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b1e4be74-ff34-4eb3-bc29-aabf6c1d1478 tempest-GroupsTest-303820755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-1d09a212-809c-4b41-8ade-10131801ed5b" returned: 0 in 0.446s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:49 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-b1e4be74-ff34-4eb3-bc29-aabf6c1d1478 tempest-GroupsTest-303820755 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:29:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-b1e4be74-ff34-4eb3-bc29-aabf6c1d1478 tempest-GroupsTest-303820755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:49 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b1e4be74-ff34-4eb3-bc29-aabf6c1d1478 tempest-GroupsTest-303820755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f5b115e-3f17-4296-96dc-f919dfdc6a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d09a212-809c-4b41-8ade-10131801ed5b', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:49 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b1e4be74-ff34-4eb3-bc29-aabf6c1d1478 tempest-GroupsTest-303820755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b6f9745-8e7b-4a46-9b5c-bcd00f2fb9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:49 devstack sudo[87437]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-16ead920-7b70-4c87-97ad-143f0d3457b6 tempest-VolumesListTestJSON-1077070625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b4120049-eff3-42f1-a03d-1114a69fb25c" returned: 0 in 0.428s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:49 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-b1e4be74-ff34-4eb3-bc29-aabf6c1d1478 tempest-GroupsTest-303820755 None] Volume volume-1d09a212-809c-4b41-8ade-10131801ed5b (1d09a212-809c-4b41-8ade-10131801ed5b): created successfully
Apr 02 10:29:49 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b1e4be74-ff34-4eb3-bc29-aabf6c1d1478 tempest-GroupsTest-303820755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b6f9745-8e7b-4a46-9b5c-bcd00f2fb9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:49 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b1e4be74-ff34-4eb3-bc29-aabf6c1d1478 tempest-GroupsTest-303820755 None] Flow 'volume_create_manager' (cfc153bf-25e8-4239-9dd8-c6cbf7604869) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:49 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-16ead920-7b70-4c87-97ad-143f0d3457b6 tempest-VolumesListTestJSON-1077070625 None] Lock "cinder-quobyte-b4120049-eff3-42f1-a03d-1114a69fb25c" released by "delete_volume" :: held 0.976s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:49 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-b1e4be74-ff34-4eb3-bc29-aabf6c1d1478 tempest-GroupsTest-303820755 None] Created volume successfully.
Apr 02 10:29:49 devstack sudo[87439]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-aa59e768-c9e1-4086-9819-0e4a794388fa tempest-VolumesActionsTest-2043573547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b15d2558-2a6e-4e80-a651-c3cd7e702337" returned: 0 in 0.451s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:49 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-aa59e768-c9e1-4086-9819-0e4a794388fa tempest-VolumesActionsTest-2043573547 None] Lock "cinder-quobyte-b15d2558-2a6e-4e80-a651-c3cd7e702337" released by "delete_volume" :: held 1.000s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:49 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-16ead920-7b70-4c87-97ad-143f0d3457b6 tempest-VolumesListTestJSON-1077070625 None] Created reservations ['eb92e218-96f0-4883-87a6-825e79750143', '19027764-3468-412a-a380-b361deefbd31', '0a8ba114-78a3-4141-bd1e-dd64b5b12c9c', '13448330-0703-4dbb-9466-df063378cc91'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:29:49 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-aa59e768-c9e1-4086-9819-0e4a794388fa tempest-VolumesActionsTest-2043573547 None] Created reservations ['9010dfbe-7916-4e35-9711-ea38009857f6', 'a373376e-c349-4f51-877c-114d4328cf6c', 'f7db2c5e-d8a3-40f7-b6aa-f8b2aecb4624', '291cff41-2657-4cb2-8ed0-ea73f3d63c52'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:29:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-16ead920-7b70-4c87-97ad-143f0d3457b6 tempest-VolumesListTestJSON-1077070625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-16ead920-7b70-4c87-97ad-143f0d3457b6 tempest-VolumesListTestJSON-1077070625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:49 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-16ead920-7b70-4c87-97ad-143f0d3457b6 tempest-VolumesListTestJSON-1077070625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:49 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-16ead920-7b70-4c87-97ad-143f0d3457b6 tempest-VolumesListTestJSON-1077070625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-16ead920-7b70-4c87-97ad-143f0d3457b6 tempest-VolumesListTestJSON-1077070625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-16ead920-7b70-4c87-97ad-143f0d3457b6 tempest-VolumesListTestJSON-1077070625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:49 devstack sudo[87444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:29:49 devstack sudo[87444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-aa59e768-c9e1-4086-9819-0e4a794388fa tempest-VolumesActionsTest-2043573547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-aa59e768-c9e1-4086-9819-0e4a794388fa tempest-VolumesActionsTest-2043573547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:49 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-aa59e768-c9e1-4086-9819-0e4a794388fa tempest-VolumesActionsTest-2043573547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:49 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-aa59e768-c9e1-4086-9819-0e4a794388fa tempest-VolumesActionsTest-2043573547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-aa59e768-c9e1-4086-9819-0e4a794388fa tempest-VolumesActionsTest-2043573547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-aa59e768-c9e1-4086-9819-0e4a794388fa tempest-VolumesActionsTest-2043573547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:49 devstack sudo[87446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:29:49 devstack sudo[87446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:50 devstack sudo[87444]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-16ead920-7b70-4c87-97ad-143f0d3457b6 tempest-VolumesListTestJSON-1077070625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.382s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:50 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-16ead920-7b70-4c87-97ad-143f0d3457b6 tempest-VolumesListTestJSON-1077070625 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:29:50 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-16ead920-7b70-4c87-97ad-143f0d3457b6 tempest-VolumesListTestJSON-1077070625 None] Deleted volume successfully.
Apr 02 10:29:50 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-16ead920-7b70-4c87-97ad-143f0d3457b6 tempest-VolumesListTestJSON-1077070625 None] Lock "cinder-b4120049-eff3-42f1-a03d-1114a69fb25c-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:50 devstack sudo[87446]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-aa59e768-c9e1-4086-9819-0e4a794388fa tempest-VolumesActionsTest-2043573547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.395s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:50 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-aa59e768-c9e1-4086-9819-0e4a794388fa tempest-VolumesActionsTest-2043573547 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:29:50 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-aa59e768-c9e1-4086-9819-0e4a794388fa tempest-VolumesActionsTest-2043573547 None] Deleted volume successfully.
Apr 02 10:29:50 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-aa59e768-c9e1-4086-9819-0e4a794388fa tempest-VolumesActionsTest-2043573547 None] Lock "cinder-b15d2558-2a6e-4e80-a651-c3cd7e702337-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:51 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5473fd19-8760-4229-9ad1-e61763b9a400 tempest-GroupsTest-303820755 None] Acquiring lock "cinder-quobyte-1d09a212-809c-4b41-8ade-10131801ed5b" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:51 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5473fd19-8760-4229-9ad1-e61763b9a400 tempest-GroupsTest-303820755 None] Lock "cinder-quobyte-1d09a212-809c-4b41-8ade-10131801ed5b" acquired by "delete_volume" :: waited 0.017s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:51 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb517cd-d1bf-46c3-8de8-6d48c34f2d9e]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:29:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5473fd19-8760-4229-9ad1-e61763b9a400 tempest-GroupsTest-303820755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-1d09a212-809c-4b41-8ade-10131801ed5b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:51 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-f625d520-5124-4484-a520-8f6e5e5bf9f9 tempest-VolumesActionsTest-1099538795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:29:51 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f625d520-5124-4484-a520-8f6e5e5bf9f9 tempest-VolumesActionsTest-1099538795 None] Flow 'volume_create_manager' (67e9a2ce-c967-43ae-ba85-da457b9e86b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:51 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f625d520-5124-4484-a520-8f6e5e5bf9f9 tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b04b6e4-6629-432d-8a73-7af2015e355e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:51 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f625d520-5124-4484-a520-8f6e5e5bf9f9 tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b04b6e4-6629-432d-8a73-7af2015e355e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1073117317',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a22726a-d615-4859-bab6-2ddd3a9f9a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92cd48ebe8bf4c4d8acbf4c15968d823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:51Z,use_quota=True,user_id='1e0b000a1a39462998b46dd57ca6b695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:51 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f625d520-5124-4484-a520-8f6e5e5bf9f9 tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5365711-c13d-40ad-97b8-258ffb914cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:51 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f625d520-5124-4484-a520-8f6e5e5bf9f9 tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5365711-c13d-40ad-97b8-258ffb914cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:51 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f625d520-5124-4484-a520-8f6e5e5bf9f9 tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b71ee9c6-cb3e-4094-b27e-8156a87e7560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:51 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f625d520-5124-4484-a520-8f6e5e5bf9f9 tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b71ee9c6-cb3e-4094-b27e-8156a87e7560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a22726a-d615-4859-bab6-2ddd3a9f9a0b', 'volume_name': 'volume-4a22726a-d615-4859-bab6-2ddd3a9f9a0b', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:51 devstack sudo[87451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-1d09a212-809c-4b41-8ade-10131801ed5b
Apr 02 10:29:51 devstack sudo[87451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:51 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f625d520-5124-4484-a520-8f6e5e5bf9f9 tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e9bfeeb-36d5-404f-bcf3-f8c84fcaf4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:51 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f625d520-5124-4484-a520-8f6e5e5bf9f9 tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e9bfeeb-36d5-404f-bcf3-f8c84fcaf4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:51 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f625d520-5124-4484-a520-8f6e5e5bf9f9 tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a72c9d-30a6-4965-b4a1-b11cca320620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:51 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-f625d520-5124-4484-a520-8f6e5e5bf9f9 tempest-VolumesActionsTest-1099538795 None] Volume 4a22726a-d615-4859-bab6-2ddd3a9f9a0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a22726a-d615-4859-bab6-2ddd3a9f9a0b', 'volume_size': 1}
Apr 02 10:29:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f625d520-5124-4484-a520-8f6e5e5bf9f9 tempest-VolumesActionsTest-1099538795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f625d520-5124-4484-a520-8f6e5e5bf9f9 tempest-VolumesActionsTest-1099538795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:51 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f625d520-5124-4484-a520-8f6e5e5bf9f9 tempest-VolumesActionsTest-1099538795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1073117317',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a22726a-d615-4859-bab6-2ddd3a9f9a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92cd48ebe8bf4c4d8acbf4c15968d823',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:51Z,use_quota=True,user_id='1e0b000a1a39462998b46dd57ca6b695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:29:51 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-f625d520-5124-4484-a520-8f6e5e5bf9f9 tempest-VolumesActionsTest-1099538795 None] Creating volume 4a22726a-d615-4859-bab6-2ddd3a9f9a0b {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:29:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f625d520-5124-4484-a520-8f6e5e5bf9f9 tempest-VolumesActionsTest-1099538795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f625d520-5124-4484-a520-8f6e5e5bf9f9 tempest-VolumesActionsTest-1099538795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:51 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f625d520-5124-4484-a520-8f6e5e5bf9f9 tempest-VolumesActionsTest-1099538795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:51 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f625d520-5124-4484-a520-8f6e5e5bf9f9 tempest-VolumesActionsTest-1099538795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f625d520-5124-4484-a520-8f6e5e5bf9f9 tempest-VolumesActionsTest-1099538795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:51 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f625d520-5124-4484-a520-8f6e5e5bf9f9 tempest-VolumesActionsTest-1099538795 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:29:51 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-f625d520-5124-4484-a520-8f6e5e5bf9f9 tempest-VolumesActionsTest-1099538795 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:29:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f625d520-5124-4484-a520-8f6e5e5bf9f9 tempest-VolumesActionsTest-1099538795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4a22726a-d615-4859-bab6-2ddd3a9f9a0b 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:51 devstack sudo[87453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4a22726a-d615-4859-bab6-2ddd3a9f9a0b 1073741824
Apr 02 10:29:51 devstack sudo[87453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:51 devstack sudo[87451]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5473fd19-8760-4229-9ad1-e61763b9a400 tempest-GroupsTest-303820755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-1d09a212-809c-4b41-8ade-10131801ed5b" returned: 0 in 0.580s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5473fd19-8760-4229-9ad1-e61763b9a400 tempest-GroupsTest-303820755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-1d09a212-809c-4b41-8ade-10131801ed5b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:51 devstack sudo[87461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-1d09a212-809c-4b41-8ade-10131801ed5b
Apr 02 10:29:51 devstack sudo[87461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:51 devstack sudo[87453]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f625d520-5124-4484-a520-8f6e5e5bf9f9 tempest-VolumesActionsTest-1099538795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4a22726a-d615-4859-bab6-2ddd3a9f9a0b 1073741824" returned: 0 in 0.540s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f625d520-5124-4484-a520-8f6e5e5bf9f9 tempest-VolumesActionsTest-1099538795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4a22726a-d615-4859-bab6-2ddd3a9f9a0b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:51 devstack sudo[87463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4a22726a-d615-4859-bab6-2ddd3a9f9a0b
Apr 02 10:29:51 devstack sudo[87463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:52 devstack sudo[87461]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5473fd19-8760-4229-9ad1-e61763b9a400 tempest-GroupsTest-303820755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-1d09a212-809c-4b41-8ade-10131801ed5b" returned: 0 in 0.535s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5473fd19-8760-4229-9ad1-e61763b9a400 tempest-GroupsTest-303820755 None] Lock "cinder-quobyte-1d09a212-809c-4b41-8ade-10131801ed5b" released by "delete_volume" :: held 1.155s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-5473fd19-8760-4229-9ad1-e61763b9a400 tempest-GroupsTest-303820755 None] Created reservations ['c02bf0c5-ec33-4ebb-8f5f-7931ab26ee39'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:29:52 devstack sudo[87463]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f625d520-5124-4484-a520-8f6e5e5bf9f9 tempest-VolumesActionsTest-1099538795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4a22726a-d615-4859-bab6-2ddd3a9f9a0b" returned: 0 in 0.524s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:52 devstack cinder-volume[82102]: WARNING cinder.quota [None req-5473fd19-8760-4229-9ad1-e61763b9a400 tempest-GroupsTest-303820755 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-284130240 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-284130240, it is now deprecated. Please use the default quota class for default quota.
Apr 02 10:29:52 devstack cinder-volume[82102]: WARNING cinder.quota [None req-5473fd19-8760-4229-9ad1-e61763b9a400 tempest-GroupsTest-303820755 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-284130240 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-284130240, it is now deprecated. Please use the default quota class for default quota.
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f625d520-5124-4484-a520-8f6e5e5bf9f9 tempest-VolumesActionsTest-1099538795 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f625d520-5124-4484-a520-8f6e5e5bf9f9 tempest-VolumesActionsTest-1099538795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-5473fd19-8760-4229-9ad1-e61763b9a400 tempest-GroupsTest-303820755 None] Created reservations ['7511b203-abea-4cdd-a7cf-9b78b263cdaf', 'eacf909a-3dcb-4517-8061-88cbd0eaf4fb', '1320b272-d2cd-4419-8150-3aeee179d8ec', 'ba8a2bd5-0d86-4261-9229-ad838831fb3e'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f625d520-5124-4484-a520-8f6e5e5bf9f9 tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a72c9d-30a6-4965-b4a1-b11cca320620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a22726a-d615-4859-bab6-2ddd3a9f9a0b', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f625d520-5124-4484-a520-8f6e5e5bf9f9 tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99d3c6cf-09ee-4c77-90d6-c364b4317af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:52 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-f625d520-5124-4484-a520-8f6e5e5bf9f9 tempest-VolumesActionsTest-1099538795 None] Volume volume-4a22726a-d615-4859-bab6-2ddd3a9f9a0b (4a22726a-d615-4859-bab6-2ddd3a9f9a0b): created successfully
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f625d520-5124-4484-a520-8f6e5e5bf9f9 tempest-VolumesActionsTest-1099538795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99d3c6cf-09ee-4c77-90d6-c364b4317af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f625d520-5124-4484-a520-8f6e5e5bf9f9 tempest-VolumesActionsTest-1099538795 None] Flow 'volume_create_manager' (67e9a2ce-c967-43ae-ba85-da457b9e86b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:52 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-f625d520-5124-4484-a520-8f6e5e5bf9f9 tempest-VolumesActionsTest-1099538795 None] Created volume successfully.
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5473fd19-8760-4229-9ad1-e61763b9a400 tempest-GroupsTest-303820755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5473fd19-8760-4229-9ad1-e61763b9a400 tempest-GroupsTest-303820755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5473fd19-8760-4229-9ad1-e61763b9a400 tempest-GroupsTest-303820755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5473fd19-8760-4229-9ad1-e61763b9a400 tempest-GroupsTest-303820755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5473fd19-8760-4229-9ad1-e61763b9a400 tempest-GroupsTest-303820755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5473fd19-8760-4229-9ad1-e61763b9a400 tempest-GroupsTest-303820755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:52 devstack sudo[87467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:29:52 devstack sudo[87467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-aad17edd-2425-4402-8abc-7603f3ffc744 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-aad17edd-2425-4402-8abc-7603f3ffc744 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Flow 'volume_create_manager' (bfa6421d-d1a6-42d7-96e1-5d0df4697e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:52 devstack sudo[87467]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-aad17edd-2425-4402-8abc-7603f3ffc744 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2acf5a9a-7ead-40b5-94fa-1ddf462db363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5473fd19-8760-4229-9ad1-e61763b9a400 tempest-GroupsTest-303820755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.443s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-5473fd19-8760-4229-9ad1-e61763b9a400 tempest-GroupsTest-303820755 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:29:52 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-5473fd19-8760-4229-9ad1-e61763b9a400 tempest-GroupsTest-303820755 None] Delete group completed successfully.
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-aad17edd-2425-4402-8abc-7603f3ffc744 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2acf5a9a-7ead-40b5-94fa-1ddf462db363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1462560157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07acbdcc-e88c-4f3a-a609-50136eda53ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ed22a5c2e264b6bad0400003bab94ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:53Z,use_quota=True,user_id='e4265f14237646a8af44202bc15303b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-aad17edd-2425-4402-8abc-7603f3ffc744 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fee47793-78b6-47e5-9bbc-4bb23755cd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-aad17edd-2425-4402-8abc-7603f3ffc744 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fee47793-78b6-47e5-9bbc-4bb23755cd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-aad17edd-2425-4402-8abc-7603f3ffc744 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1850067-8f3e-4989-8076-ac37bb10bc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-aad17edd-2425-4402-8abc-7603f3ffc744 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1850067-8f3e-4989-8076-ac37bb10bc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07acbdcc-e88c-4f3a-a609-50136eda53ee', 'volume_name': 'volume-07acbdcc-e88c-4f3a-a609-50136eda53ee', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-aad17edd-2425-4402-8abc-7603f3ffc744 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (420dbf9f-27fb-4078-95a0-ba6a63432173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-aad17edd-2425-4402-8abc-7603f3ffc744 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (420dbf9f-27fb-4078-95a0-ba6a63432173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-aad17edd-2425-4402-8abc-7603f3ffc744 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e8e285-7a14-45bb-80b7-87959fa264c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:52 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-aad17edd-2425-4402-8abc-7603f3ffc744 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Volume 07acbdcc-e88c-4f3a-a609-50136eda53ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07acbdcc-e88c-4f3a-a609-50136eda53ee', 'volume_size': 1}
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-aad17edd-2425-4402-8abc-7603f3ffc744 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-aad17edd-2425-4402-8abc-7603f3ffc744 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-aad17edd-2425-4402-8abc-7603f3ffc744 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1462560157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07acbdcc-e88c-4f3a-a609-50136eda53ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ed22a5c2e264b6bad0400003bab94ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:53Z,use_quota=True,user_id='e4265f14237646a8af44202bc15303b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-aad17edd-2425-4402-8abc-7603f3ffc744 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Creating volume 07acbdcc-e88c-4f3a-a609-50136eda53ee {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-aad17edd-2425-4402-8abc-7603f3ffc744 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-aad17edd-2425-4402-8abc-7603f3ffc744 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-aad17edd-2425-4402-8abc-7603f3ffc744 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-aad17edd-2425-4402-8abc-7603f3ffc744 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-aad17edd-2425-4402-8abc-7603f3ffc744 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-aad17edd-2425-4402-8abc-7603f3ffc744 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:29:52 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-aad17edd-2425-4402-8abc-7603f3ffc744 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:29:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-aad17edd-2425-4402-8abc-7603f3ffc744 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-07acbdcc-e88c-4f3a-a609-50136eda53ee 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:52 devstack sudo[87470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-07acbdcc-e88c-4f3a-a609-50136eda53ee 1073741824
Apr 02 10:29:52 devstack sudo[87470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:53 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-6f34bde3-d5e2-48f5-98ed-ef75e7107fc4 tempest-GroupsTest-303820755 None] Created reservations ['19348239-766d-4b64-9431-f78b401a9261'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:29:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-6f34bde3-d5e2-48f5-98ed-ef75e7107fc4 tempest-GroupsTest-303820755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-6f34bde3-d5e2-48f5-98ed-ef75e7107fc4 tempest-GroupsTest-303820755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:53 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-6f34bde3-d5e2-48f5-98ed-ef75e7107fc4 tempest-GroupsTest-303820755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:53 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-6f34bde3-d5e2-48f5-98ed-ef75e7107fc4 tempest-GroupsTest-303820755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-6f34bde3-d5e2-48f5-98ed-ef75e7107fc4 tempest-GroupsTest-303820755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6f34bde3-d5e2-48f5-98ed-ef75e7107fc4 tempest-GroupsTest-303820755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:53 devstack sudo[87475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:29:53 devstack sudo[87475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:53 devstack sudo[87470]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-aad17edd-2425-4402-8abc-7603f3ffc744 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-07acbdcc-e88c-4f3a-a609-50136eda53ee 1073741824" returned: 0 in 0.582s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-aad17edd-2425-4402-8abc-7603f3ffc744 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-07acbdcc-e88c-4f3a-a609-50136eda53ee {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:53 devstack sudo[87477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-07acbdcc-e88c-4f3a-a609-50136eda53ee
Apr 02 10:29:53 devstack sudo[87477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:53 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-d7465b06-b669-4ab4-8b07-7149ed4e44c2 tempest-VolumesActionsTest-1099538795 None] Acquiring lock "cinder-4a22726a-d615-4859-bab6-2ddd3a9f9a0b-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:53 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-d7465b06-b669-4ab4-8b07-7149ed4e44c2 tempest-VolumesActionsTest-1099538795 None] Lock "cinder-4a22726a-d615-4859-bab6-2ddd3a9f9a0b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:53 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-d7465b06-b669-4ab4-8b07-7149ed4e44c2 tempest-VolumesActionsTest-1099538795 None] Acquiring lock "cinder-quobyte-4a22726a-d615-4859-bab6-2ddd3a9f9a0b" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:29:53 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-d7465b06-b669-4ab4-8b07-7149ed4e44c2 tempest-VolumesActionsTest-1099538795 None] Lock "cinder-quobyte-4a22726a-d615-4859-bab6-2ddd3a9f9a0b" acquired by "delete_volume" :: waited 0.020s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:29:53 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[26dc28a7-4dbd-41de-b049-d8ff76b7a7fc]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:29:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d7465b06-b669-4ab4-8b07-7149ed4e44c2 tempest-VolumesActionsTest-1099538795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4a22726a-d615-4859-bab6-2ddd3a9f9a0b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:53 devstack sudo[87475]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6f34bde3-d5e2-48f5-98ed-ef75e7107fc4 tempest-GroupsTest-303820755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.465s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:53 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-6f34bde3-d5e2-48f5-98ed-ef75e7107fc4 tempest-GroupsTest-303820755 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:29:53 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-6f34bde3-d5e2-48f5-98ed-ef75e7107fc4 tempest-GroupsTest-303820755 None] Delete group completed successfully.
Apr 02 10:29:53 devstack sudo[87480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4a22726a-d615-4859-bab6-2ddd3a9f9a0b
Apr 02 10:29:53 devstack sudo[87480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:54 devstack sudo[87477]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-aad17edd-2425-4402-8abc-7603f3ffc744 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-07acbdcc-e88c-4f3a-a609-50136eda53ee" returned: 0 in 0.470s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:54 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-aad17edd-2425-4402-8abc-7603f3ffc744 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:29:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-aad17edd-2425-4402-8abc-7603f3ffc744 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:54 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-aad17edd-2425-4402-8abc-7603f3ffc744 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e8e285-7a14-45bb-80b7-87959fa264c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07acbdcc-e88c-4f3a-a609-50136eda53ee', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:54 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-aad17edd-2425-4402-8abc-7603f3ffc744 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dc6cf73-22aa-48d4-a0ca-0bb7c10810b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:54 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-aad17edd-2425-4402-8abc-7603f3ffc744 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Volume volume-07acbdcc-e88c-4f3a-a609-50136eda53ee (07acbdcc-e88c-4f3a-a609-50136eda53ee): created successfully
Apr 02 10:29:54 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-aad17edd-2425-4402-8abc-7603f3ffc744 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dc6cf73-22aa-48d4-a0ca-0bb7c10810b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:54 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-aad17edd-2425-4402-8abc-7603f3ffc744 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Flow 'volume_create_manager' (bfa6421d-d1a6-42d7-96e1-5d0df4697e63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:54 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-aad17edd-2425-4402-8abc-7603f3ffc744 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Created volume successfully.
Apr 02 10:29:54 devstack sudo[87480]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d7465b06-b669-4ab4-8b07-7149ed4e44c2 tempest-VolumesActionsTest-1099538795 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4a22726a-d615-4859-bab6-2ddd3a9f9a0b" returned: 0 in 0.475s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d7465b06-b669-4ab4-8b07-7149ed4e44c2 tempest-VolumesActionsTest-1099538795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4a22726a-d615-4859-bab6-2ddd3a9f9a0b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:54 devstack sudo[87486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4a22726a-d615-4859-bab6-2ddd3a9f9a0b
Apr 02 10:29:54 devstack sudo[87486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:54 devstack sudo[87486]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d7465b06-b669-4ab4-8b07-7149ed4e44c2 tempest-VolumesActionsTest-1099538795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4a22726a-d615-4859-bab6-2ddd3a9f9a0b" returned: 0 in 0.482s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:54 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-d7465b06-b669-4ab4-8b07-7149ed4e44c2 tempest-VolumesActionsTest-1099538795 None] Lock "cinder-quobyte-4a22726a-d615-4859-bab6-2ddd3a9f9a0b" released by "delete_volume" :: held 0.983s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:54 devstack cinder-volume[82102]: DEBUG dbcounter [-] [82102] Writing DB stats cinder:SELECT=232,cinder:UPDATE=304,cinder:INSERT=76,cinder:DELETE=22 {{(pid=82102) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 02 10:29:54 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-bffe2179-00a8-4640-b7f5-51c5077c560e tempest-GroupsTest-303820755 None] Group tempest-GroupsTest-Group-946860190: creating
Apr 02 10:29:54 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-bffe2179-00a8-4640-b7f5-51c5077c560e tempest-GroupsTest-303820755 None] Group tempest-GroupsTest-Group-946860190: created successfully
Apr 02 10:29:54 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-d7465b06-b669-4ab4-8b07-7149ed4e44c2 tempest-VolumesActionsTest-1099538795 None] Created reservations ['e255af09-0fa8-47d4-ab7a-3118b33408c4', 'c92577c7-126e-4828-8abb-ba5811655f7a', '3489ae56-d599-4790-8bbf-15eff05b4386', 'a8cafef0-41f7-4e73-8c53-ed8a52496219'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:29:54 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-bffe2179-00a8-4640-b7f5-51c5077c560e tempest-GroupsTest-303820755 None] Create group completed successfully.
Apr 02 10:29:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d7465b06-b669-4ab4-8b07-7149ed4e44c2 tempest-VolumesActionsTest-1099538795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d7465b06-b669-4ab4-8b07-7149ed4e44c2 tempest-VolumesActionsTest-1099538795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:54 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d7465b06-b669-4ab4-8b07-7149ed4e44c2 tempest-VolumesActionsTest-1099538795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:54 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d7465b06-b669-4ab4-8b07-7149ed4e44c2 tempest-VolumesActionsTest-1099538795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d7465b06-b669-4ab4-8b07-7149ed4e44c2 tempest-VolumesActionsTest-1099538795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d7465b06-b669-4ab4-8b07-7149ed4e44c2 tempest-VolumesActionsTest-1099538795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:54 devstack sudo[87489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:29:54 devstack sudo[87489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-9daeed91-5da9-4746-993f-a7fa2528706b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9daeed91-5da9-4746-993f-a7fa2528706b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Flow 'volume_create_manager' (aa4d43ec-40ca-45f3-af2c-a161a49d9192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9daeed91-5da9-4746-993f-a7fa2528706b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b01152a7-bcfe-4235-aa40-345d929068b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9daeed91-5da9-4746-993f-a7fa2528706b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b01152a7-bcfe-4235-aa40-345d929068b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1568949308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9670af2a-d9d5-4242-a7f2-b43cb314176a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ed22a5c2e264b6bad0400003bab94ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:55Z,use_quota=True,user_id='e4265f14237646a8af44202bc15303b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9daeed91-5da9-4746-993f-a7fa2528706b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8228c539-b21b-4b4a-bbe3-86ef6906c951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9daeed91-5da9-4746-993f-a7fa2528706b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8228c539-b21b-4b4a-bbe3-86ef6906c951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9daeed91-5da9-4746-993f-a7fa2528706b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2969b57-9740-4f94-8255-a3d15453fea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9daeed91-5da9-4746-993f-a7fa2528706b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2969b57-9740-4f94-8255-a3d15453fea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9670af2a-d9d5-4242-a7f2-b43cb314176a', 'volume_name': 'volume-9670af2a-d9d5-4242-a7f2-b43cb314176a', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9daeed91-5da9-4746-993f-a7fa2528706b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf0c9ae-6b45-4140-9d12-f339728258ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9daeed91-5da9-4746-993f-a7fa2528706b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf0c9ae-6b45-4140-9d12-f339728258ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9daeed91-5da9-4746-993f-a7fa2528706b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4847e209-49cf-4f54-8f0d-aaf4d44b04d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:55 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-9daeed91-5da9-4746-993f-a7fa2528706b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Volume 9670af2a-d9d5-4242-a7f2-b43cb314176a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9670af2a-d9d5-4242-a7f2-b43cb314176a', 'volume_size': 1}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-9daeed91-5da9-4746-993f-a7fa2528706b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-9daeed91-5da9-4746-993f-a7fa2528706b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-9daeed91-5da9-4746-993f-a7fa2528706b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1568949308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9670af2a-d9d5-4242-a7f2-b43cb314176a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ed22a5c2e264b6bad0400003bab94ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:55Z,use_quota=True,user_id='e4265f14237646a8af44202bc15303b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-9daeed91-5da9-4746-993f-a7fa2528706b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Creating volume 9670af2a-d9d5-4242-a7f2-b43cb314176a {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-9daeed91-5da9-4746-993f-a7fa2528706b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-9daeed91-5da9-4746-993f-a7fa2528706b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-9daeed91-5da9-4746-993f-a7fa2528706b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-9daeed91-5da9-4746-993f-a7fa2528706b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-9daeed91-5da9-4746-993f-a7fa2528706b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-9daeed91-5da9-4746-993f-a7fa2528706b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:29:55 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-9daeed91-5da9-4746-993f-a7fa2528706b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9daeed91-5da9-4746-993f-a7fa2528706b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9670af2a-d9d5-4242-a7f2-b43cb314176a 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:55 devstack sudo[87492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9670af2a-d9d5-4242-a7f2-b43cb314176a 1073741824
Apr 02 10:29:55 devstack sudo[87492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:55 devstack sudo[87489]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d7465b06-b669-4ab4-8b07-7149ed4e44c2 tempest-VolumesActionsTest-1099538795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.478s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-d7465b06-b669-4ab4-8b07-7149ed4e44c2 tempest-VolumesActionsTest-1099538795 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:29:55 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-d7465b06-b669-4ab4-8b07-7149ed4e44c2 tempest-VolumesActionsTest-1099538795 None] Deleted volume successfully.
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG dbcounter [-] [82102] Writing DB stats cinder:UPDATE=294,cinder:SELECT=247,cinder:INSERT=60,cinder:DELETE=18 {{(pid=82102) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-d7465b06-b669-4ab4-8b07-7149ed4e44c2 tempest-VolumesActionsTest-1099538795 None] Lock "cinder-4a22726a-d615-4859-bab6-2ddd3a9f9a0b-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb083d93-f2e7-450e-8cd4-b36da6f02e65 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-cb083d93-f2e7-450e-8cd4-b36da6f02e65 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Flow 'volume_create_manager' (675fb12c-db0f-4372-8c7a-b4e9c7edd5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-cb083d93-f2e7-450e-8cd4-b36da6f02e65 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (831d42a7-57ba-4be5-8da6-7354671f61a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-cb083d93-f2e7-450e-8cd4-b36da6f02e65 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (831d42a7-57ba-4be5-8da6-7354671f61a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-341635088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71cc7649-e80f-4a62-b9d3-e9e35eb34191,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ed22a5c2e264b6bad0400003bab94ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:55Z,use_quota=True,user_id='e4265f14237646a8af44202bc15303b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-cb083d93-f2e7-450e-8cd4-b36da6f02e65 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (544645e0-2143-4093-8a81-2c56dd2c9ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-cb083d93-f2e7-450e-8cd4-b36da6f02e65 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (544645e0-2143-4093-8a81-2c56dd2c9ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-cb083d93-f2e7-450e-8cd4-b36da6f02e65 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a194598-67aa-42fe-a6d1-0ac895df2c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-cb083d93-f2e7-450e-8cd4-b36da6f02e65 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a194598-67aa-42fe-a6d1-0ac895df2c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71cc7649-e80f-4a62-b9d3-e9e35eb34191', 'volume_name': 'volume-71cc7649-e80f-4a62-b9d3-e9e35eb34191', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-cb083d93-f2e7-450e-8cd4-b36da6f02e65 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2779eda1-0149-4d0d-a9a0-c6b519b1ba3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-cb083d93-f2e7-450e-8cd4-b36da6f02e65 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2779eda1-0149-4d0d-a9a0-c6b519b1ba3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-cb083d93-f2e7-450e-8cd4-b36da6f02e65 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1397bdf-4e44-43f8-b37a-056aa4963ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:55 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-cb083d93-f2e7-450e-8cd4-b36da6f02e65 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Volume 71cc7649-e80f-4a62-b9d3-e9e35eb34191: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71cc7649-e80f-4a62-b9d3-e9e35eb34191', 'volume_size': 1}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-cb083d93-f2e7-450e-8cd4-b36da6f02e65 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-47cdf2ee-ffa5-423e-bd40-8166803d867b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-47cdf2ee-ffa5-423e-bd40-8166803d867b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Flow 'volume_create_manager' (448fc06d-15d2-466b-87a7-7b50f0262a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-47cdf2ee-ffa5-423e-bd40-8166803d867b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0456f00-a0b1-479c-b073-01697efef5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-47cdf2ee-ffa5-423e-bd40-8166803d867b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0456f00-a0b1-479c-b073-01697efef5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-716906822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c537ebc4-c3a1-4ca1-9305-53aa81fd6e7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ed22a5c2e264b6bad0400003bab94ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:56Z,use_quota=True,user_id='e4265f14237646a8af44202bc15303b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-47cdf2ee-ffa5-423e-bd40-8166803d867b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2218a53a-c410-4c48-baed-6619d8354d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-47cdf2ee-ffa5-423e-bd40-8166803d867b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2218a53a-c410-4c48-baed-6619d8354d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-47cdf2ee-ffa5-423e-bd40-8166803d867b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (644e9bbb-5f5b-40da-8f4c-56fa7d8b9671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-47cdf2ee-ffa5-423e-bd40-8166803d867b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (644e9bbb-5f5b-40da-8f4c-56fa7d8b9671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c537ebc4-c3a1-4ca1-9305-53aa81fd6e7c', 'volume_name': 'volume-c537ebc4-c3a1-4ca1-9305-53aa81fd6e7c', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-47cdf2ee-ffa5-423e-bd40-8166803d867b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14b32ab6-c941-4db6-8c0a-c295ed01677a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-47cdf2ee-ffa5-423e-bd40-8166803d867b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14b32ab6-c941-4db6-8c0a-c295ed01677a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-47cdf2ee-ffa5-423e-bd40-8166803d867b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd46bb27-b98d-4b6d-b2f1-11acfba59d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:55 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-47cdf2ee-ffa5-423e-bd40-8166803d867b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Volume c537ebc4-c3a1-4ca1-9305-53aa81fd6e7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c537ebc4-c3a1-4ca1-9305-53aa81fd6e7c', 'volume_size': 1}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-47cdf2ee-ffa5-423e-bd40-8166803d867b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8110b22-4044-4d90-ad87-b2c6d3f0683b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f8110b22-4044-4d90-ad87-b2c6d3f0683b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Flow 'volume_create_manager' (43b6d2b1-bc4f-4d5b-9777-e355c913f689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f8110b22-4044-4d90-ad87-b2c6d3f0683b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a5910f-7a69-4b76-bc5c-49ff4f8f4c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f8110b22-4044-4d90-ad87-b2c6d3f0683b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a5910f-7a69-4b76-bc5c-49ff4f8f4c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2010699290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f85661d1-7c0a-4633-a2bf-473a4eea0462,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ed22a5c2e264b6bad0400003bab94ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:56Z,use_quota=True,user_id='e4265f14237646a8af44202bc15303b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f8110b22-4044-4d90-ad87-b2c6d3f0683b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28eee6d7-0ab8-4e9e-8ab7-8c416e4b01e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f8110b22-4044-4d90-ad87-b2c6d3f0683b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28eee6d7-0ab8-4e9e-8ab7-8c416e4b01e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f8110b22-4044-4d90-ad87-b2c6d3f0683b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61ff0de4-bc56-4d71-af91-8082e2ef42f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f8110b22-4044-4d90-ad87-b2c6d3f0683b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61ff0de4-bc56-4d71-af91-8082e2ef42f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f85661d1-7c0a-4633-a2bf-473a4eea0462', 'volume_name': 'volume-f85661d1-7c0a-4633-a2bf-473a4eea0462', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f8110b22-4044-4d90-ad87-b2c6d3f0683b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0cb1989-3aeb-44e9-945f-f527ed25e8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f8110b22-4044-4d90-ad87-b2c6d3f0683b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0cb1989-3aeb-44e9-945f-f527ed25e8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:56 devstack sudo[87492]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f8110b22-4044-4d90-ad87-b2c6d3f0683b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16485923-6eaf-4041-a194-16870ab069d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:56 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-f8110b22-4044-4d90-ad87-b2c6d3f0683b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Volume f85661d1-7c0a-4633-a2bf-473a4eea0462: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f85661d1-7c0a-4633-a2bf-473a4eea0462', 'volume_size': 1}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f8110b22-4044-4d90-ad87-b2c6d3f0683b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9daeed91-5da9-4746-993f-a7fa2528706b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9670af2a-d9d5-4242-a7f2-b43cb314176a 1073741824" returned: 0 in 0.670s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9daeed91-5da9-4746-993f-a7fa2528706b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9670af2a-d9d5-4242-a7f2-b43cb314176a {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:56 devstack sudo[87497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9670af2a-d9d5-4242-a7f2-b43cb314176a
Apr 02 10:29:56 devstack sudo[87497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a30f4a1-cc0a-44e2-9725-f5b88de59cbc tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9a30f4a1-cc0a-44e2-9725-f5b88de59cbc tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Flow 'volume_create_manager' (7f691103-fc4e-4c86-b2c3-ed36e0f34915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9a30f4a1-cc0a-44e2-9725-f5b88de59cbc tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a52568-d335-4a24-96a6-3cb1b09bd697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9a30f4a1-cc0a-44e2-9725-f5b88de59cbc tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a52568-d335-4a24-96a6-3cb1b09bd697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1733546958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6371929-6aec-4d6d-b827-f722b62fe169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ed22a5c2e264b6bad0400003bab94ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:56Z,use_quota=True,user_id='e4265f14237646a8af44202bc15303b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9a30f4a1-cc0a-44e2-9725-f5b88de59cbc tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f09915a-9787-4fd5-8799-3db81d3dd9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9a30f4a1-cc0a-44e2-9725-f5b88de59cbc tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f09915a-9787-4fd5-8799-3db81d3dd9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9a30f4a1-cc0a-44e2-9725-f5b88de59cbc tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d4f8012-3e56-4986-be43-3fce2a21eaf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9a30f4a1-cc0a-44e2-9725-f5b88de59cbc tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d4f8012-3e56-4986-be43-3fce2a21eaf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6371929-6aec-4d6d-b827-f722b62fe169', 'volume_name': 'volume-b6371929-6aec-4d6d-b827-f722b62fe169', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9a30f4a1-cc0a-44e2-9725-f5b88de59cbc tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24dfa244-e57b-4156-92df-9d02b6058ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9a30f4a1-cc0a-44e2-9725-f5b88de59cbc tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24dfa244-e57b-4156-92df-9d02b6058ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9a30f4a1-cc0a-44e2-9725-f5b88de59cbc tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e45d1fa0-8e0e-419e-bc4a-64fd513ee700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:56 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-9a30f4a1-cc0a-44e2-9725-f5b88de59cbc tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Volume b6371929-6aec-4d6d-b827-f722b62fe169: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6371929-6aec-4d6d-b827-f722b62fe169', 'volume_size': 1}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-9a30f4a1-cc0a-44e2-9725-f5b88de59cbc tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ededbce-c3ff-4b6d-8e44-62f35a0ee462 tempest-GroupsTest-303820755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7ededbce-c3ff-4b6d-8e44-62f35a0ee462 tempest-GroupsTest-303820755 None] Flow 'volume_create_manager' (d4f0ce52-6240-469f-9f10-0c87f1cf1740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7ededbce-c3ff-4b6d-8e44-62f35a0ee462 tempest-GroupsTest-303820755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (409f951c-2046-41f8-8d64-c81c0046757b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7ededbce-c3ff-4b6d-8e44-62f35a0ee462 tempest-GroupsTest-303820755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (409f951c-2046-41f8-8d64-c81c0046757b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1727021349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c0cda9de-2ea6-45d4-acf3-7c3ef50f144d,host='devstack@QuobyteHD#QuobyteHD',id=f2abea79-5b1f-4475-820a-951fe5743d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3e8fa7494b473c9621c99d272f55a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:56Z,use_quota=True,user_id='2cab7f12c1be4724aee57975c8e853b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e3932ef-1e30-4659-8986-f2dbfe9e5b0e),volume_type_id=2e3932ef-1e30-4659-8986-f2dbfe9e5b0e)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7ededbce-c3ff-4b6d-8e44-62f35a0ee462 tempest-GroupsTest-303820755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e391df1-5464-485a-8f4b-b312ea58994d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7ededbce-c3ff-4b6d-8e44-62f35a0ee462 tempest-GroupsTest-303820755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e391df1-5464-485a-8f4b-b312ea58994d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7ededbce-c3ff-4b6d-8e44-62f35a0ee462 tempest-GroupsTest-303820755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f82115ab-806a-4860-be3f-bba0c06631e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7ededbce-c3ff-4b6d-8e44-62f35a0ee462 tempest-GroupsTest-303820755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f82115ab-806a-4860-be3f-bba0c06631e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2abea79-5b1f-4475-820a-951fe5743d76', 'volume_name': 'volume-f2abea79-5b1f-4475-820a-951fe5743d76', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7ededbce-c3ff-4b6d-8e44-62f35a0ee462 tempest-GroupsTest-303820755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab244527-d9da-4d66-bd65-91b374a7ff2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7ededbce-c3ff-4b6d-8e44-62f35a0ee462 tempest-GroupsTest-303820755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab244527-d9da-4d66-bd65-91b374a7ff2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7ededbce-c3ff-4b6d-8e44-62f35a0ee462 tempest-GroupsTest-303820755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db7626e2-4943-47a8-88e7-8da57d97980d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:56 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-7ededbce-c3ff-4b6d-8e44-62f35a0ee462 tempest-GroupsTest-303820755 None] Volume f2abea79-5b1f-4475-820a-951fe5743d76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2abea79-5b1f-4475-820a-951fe5743d76', 'volume_size': 1}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-7ededbce-c3ff-4b6d-8e44-62f35a0ee462 tempest-GroupsTest-303820755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:56 devstack sudo[87497]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9daeed91-5da9-4746-993f-a7fa2528706b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9670af2a-d9d5-4242-a7f2-b43cb314176a" returned: 0 in 0.473s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-9daeed91-5da9-4746-993f-a7fa2528706b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-9daeed91-5da9-4746-993f-a7fa2528706b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-cb083d93-f2e7-450e-8cd4-b36da6f02e65 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.955s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-cb083d93-f2e7-450e-8cd4-b36da6f02e65 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-341635088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71cc7649-e80f-4a62-b9d3-e9e35eb34191,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ed22a5c2e264b6bad0400003bab94ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:55Z,use_quota=True,user_id='e4265f14237646a8af44202bc15303b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-cb083d93-f2e7-450e-8cd4-b36da6f02e65 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Creating volume 71cc7649-e80f-4a62-b9d3-e9e35eb34191 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-cb083d93-f2e7-450e-8cd4-b36da6f02e65 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-cb083d93-f2e7-450e-8cd4-b36da6f02e65 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-cb083d93-f2e7-450e-8cd4-b36da6f02e65 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-cb083d93-f2e7-450e-8cd4-b36da6f02e65 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-cb083d93-f2e7-450e-8cd4-b36da6f02e65 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-cb083d93-f2e7-450e-8cd4-b36da6f02e65 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:29:56 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-cb083d93-f2e7-450e-8cd4-b36da6f02e65 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cb083d93-f2e7-450e-8cd4-b36da6f02e65 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-71cc7649-e80f-4a62-b9d3-e9e35eb34191 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9daeed91-5da9-4746-993f-a7fa2528706b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4847e209-49cf-4f54-8f0d-aaf4d44b04d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9670af2a-d9d5-4242-a7f2-b43cb314176a', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:56 devstack sudo[87503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-71cc7649-e80f-4a62-b9d3-e9e35eb34191 1073741824
Apr 02 10:29:56 devstack sudo[87503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9daeed91-5da9-4746-993f-a7fa2528706b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c1383c-f4f1-4600-8d83-e7508861940a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:56 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-9daeed91-5da9-4746-993f-a7fa2528706b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Volume volume-9670af2a-d9d5-4242-a7f2-b43cb314176a (9670af2a-d9d5-4242-a7f2-b43cb314176a): created successfully
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9daeed91-5da9-4746-993f-a7fa2528706b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c1383c-f4f1-4600-8d83-e7508861940a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9daeed91-5da9-4746-993f-a7fa2528706b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Flow 'volume_create_manager' (aa4d43ec-40ca-45f3-af2c-a161a49d9192) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:56 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-9daeed91-5da9-4746-993f-a7fa2528706b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Created volume successfully.
Apr 02 10:29:57 devstack sudo[87503]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cb083d93-f2e7-450e-8cd4-b36da6f02e65 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-71cc7649-e80f-4a62-b9d3-e9e35eb34191 1073741824" returned: 0 in 0.546s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cb083d93-f2e7-450e-8cd4-b36da6f02e65 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-71cc7649-e80f-4a62-b9d3-e9e35eb34191 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:57 devstack sudo[87508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-71cc7649-e80f-4a62-b9d3-e9e35eb34191
Apr 02 10:29:57 devstack sudo[87508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:57 devstack sudo[87508]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cb083d93-f2e7-450e-8cd4-b36da6f02e65 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-71cc7649-e80f-4a62-b9d3-e9e35eb34191" returned: 0 in 0.439s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:57 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-cb083d93-f2e7-450e-8cd4-b36da6f02e65 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:29:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-cb083d93-f2e7-450e-8cd4-b36da6f02e65 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-47cdf2ee-ffa5-423e-bd40-8166803d867b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.806s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:57 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-47cdf2ee-ffa5-423e-bd40-8166803d867b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-716906822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c537ebc4-c3a1-4ca1-9305-53aa81fd6e7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ed22a5c2e264b6bad0400003bab94ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:56Z,use_quota=True,user_id='e4265f14237646a8af44202bc15303b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:29:57 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-47cdf2ee-ffa5-423e-bd40-8166803d867b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Creating volume c537ebc4-c3a1-4ca1-9305-53aa81fd6e7c {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:29:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-47cdf2ee-ffa5-423e-bd40-8166803d867b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-47cdf2ee-ffa5-423e-bd40-8166803d867b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:57 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-47cdf2ee-ffa5-423e-bd40-8166803d867b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:57 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-47cdf2ee-ffa5-423e-bd40-8166803d867b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-47cdf2ee-ffa5-423e-bd40-8166803d867b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:57 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-47cdf2ee-ffa5-423e-bd40-8166803d867b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:29:57 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-47cdf2ee-ffa5-423e-bd40-8166803d867b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:29:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-47cdf2ee-ffa5-423e-bd40-8166803d867b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c537ebc4-c3a1-4ca1-9305-53aa81fd6e7c 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:57 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-cb083d93-f2e7-450e-8cd4-b36da6f02e65 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1397bdf-4e44-43f8-b37a-056aa4963ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71cc7649-e80f-4a62-b9d3-e9e35eb34191', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:57 devstack sudo[87512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c537ebc4-c3a1-4ca1-9305-53aa81fd6e7c 1073741824
Apr 02 10:29:57 devstack sudo[87512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:57 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-cb083d93-f2e7-450e-8cd4-b36da6f02e65 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30fe1fdf-4304-4c61-b24e-ca6a2c3e56e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:57 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-cb083d93-f2e7-450e-8cd4-b36da6f02e65 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Volume volume-71cc7649-e80f-4a62-b9d3-e9e35eb34191 (71cc7649-e80f-4a62-b9d3-e9e35eb34191): created successfully
Apr 02 10:29:57 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-cb083d93-f2e7-450e-8cd4-b36da6f02e65 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30fe1fdf-4304-4c61-b24e-ca6a2c3e56e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:57 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-cb083d93-f2e7-450e-8cd4-b36da6f02e65 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Flow 'volume_create_manager' (675fb12c-db0f-4372-8c7a-b4e9c7edd5b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:57 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-cb083d93-f2e7-450e-8cd4-b36da6f02e65 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Created volume successfully.
Apr 02 10:29:58 devstack sudo[87512]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-47cdf2ee-ffa5-423e-bd40-8166803d867b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c537ebc4-c3a1-4ca1-9305-53aa81fd6e7c 1073741824" returned: 0 in 0.537s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-47cdf2ee-ffa5-423e-bd40-8166803d867b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c537ebc4-c3a1-4ca1-9305-53aa81fd6e7c {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:58 devstack sudo[87517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c537ebc4-c3a1-4ca1-9305-53aa81fd6e7c
Apr 02 10:29:58 devstack sudo[87517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:58 devstack sudo[87517]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-47cdf2ee-ffa5-423e-bd40-8166803d867b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c537ebc4-c3a1-4ca1-9305-53aa81fd6e7c" returned: 0 in 0.477s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:58 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-47cdf2ee-ffa5-423e-bd40-8166803d867b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:29:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-47cdf2ee-ffa5-423e-bd40-8166803d867b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f8110b22-4044-4d90-ad87-b2c6d3f0683b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.577s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:58 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f8110b22-4044-4d90-ad87-b2c6d3f0683b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2010699290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f85661d1-7c0a-4633-a2bf-473a4eea0462,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ed22a5c2e264b6bad0400003bab94ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:56Z,use_quota=True,user_id='e4265f14237646a8af44202bc15303b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:29:58 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-f8110b22-4044-4d90-ad87-b2c6d3f0683b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Creating volume f85661d1-7c0a-4633-a2bf-473a4eea0462 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:29:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f8110b22-4044-4d90-ad87-b2c6d3f0683b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f8110b22-4044-4d90-ad87-b2c6d3f0683b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:58 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f8110b22-4044-4d90-ad87-b2c6d3f0683b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:58 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f8110b22-4044-4d90-ad87-b2c6d3f0683b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f8110b22-4044-4d90-ad87-b2c6d3f0683b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:58 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f8110b22-4044-4d90-ad87-b2c6d3f0683b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:29:58 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-f8110b22-4044-4d90-ad87-b2c6d3f0683b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:29:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f8110b22-4044-4d90-ad87-b2c6d3f0683b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f85661d1-7c0a-4633-a2bf-473a4eea0462 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:58 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-47cdf2ee-ffa5-423e-bd40-8166803d867b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd46bb27-b98d-4b6d-b2f1-11acfba59d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c537ebc4-c3a1-4ca1-9305-53aa81fd6e7c', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:58 devstack sudo[87520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f85661d1-7c0a-4633-a2bf-473a4eea0462 1073741824
Apr 02 10:29:58 devstack sudo[87520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:58 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-47cdf2ee-ffa5-423e-bd40-8166803d867b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (917c1074-783c-49f8-95b9-b8ab0fc1e16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:58 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-47cdf2ee-ffa5-423e-bd40-8166803d867b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Volume volume-c537ebc4-c3a1-4ca1-9305-53aa81fd6e7c (c537ebc4-c3a1-4ca1-9305-53aa81fd6e7c): created successfully
Apr 02 10:29:58 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-47cdf2ee-ffa5-423e-bd40-8166803d867b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (917c1074-783c-49f8-95b9-b8ab0fc1e16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:58 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-47cdf2ee-ffa5-423e-bd40-8166803d867b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Flow 'volume_create_manager' (448fc06d-15d2-466b-87a7-7b50f0262a88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:58 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-47cdf2ee-ffa5-423e-bd40-8166803d867b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Created volume successfully.
Apr 02 10:29:59 devstack sudo[87520]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f8110b22-4044-4d90-ad87-b2c6d3f0683b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f85661d1-7c0a-4633-a2bf-473a4eea0462 1073741824" returned: 0 in 0.557s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f8110b22-4044-4d90-ad87-b2c6d3f0683b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f85661d1-7c0a-4633-a2bf-473a4eea0462 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:59 devstack sudo[87526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f85661d1-7c0a-4633-a2bf-473a4eea0462
Apr 02 10:29:59 devstack sudo[87526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:59 devstack sudo[87526]: pam_unix(sudo:session): session closed for user root
Apr 02 10:29:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f8110b22-4044-4d90-ad87-b2c6d3f0683b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f85661d1-7c0a-4633-a2bf-473a4eea0462" returned: 0 in 0.459s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:29:59 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f8110b22-4044-4d90-ad87-b2c6d3f0683b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:29:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f8110b22-4044-4d90-ad87-b2c6d3f0683b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-9a30f4a1-cc0a-44e2-9725-f5b88de59cbc tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.240s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:59 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-9a30f4a1-cc0a-44e2-9725-f5b88de59cbc tempest-CreateVolumesFromSourceVolumeTest-820234955 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1733546958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6371929-6aec-4d6d-b827-f722b62fe169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ed22a5c2e264b6bad0400003bab94ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:56Z,use_quota=True,user_id='e4265f14237646a8af44202bc15303b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:29:59 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-9a30f4a1-cc0a-44e2-9725-f5b88de59cbc tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Creating volume b6371929-6aec-4d6d-b827-f722b62fe169 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:29:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-9a30f4a1-cc0a-44e2-9725-f5b88de59cbc tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:29:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-9a30f4a1-cc0a-44e2-9725-f5b88de59cbc tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:29:59 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-9a30f4a1-cc0a-44e2-9725-f5b88de59cbc tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:29:59 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-9a30f4a1-cc0a-44e2-9725-f5b88de59cbc tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:29:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-9a30f4a1-cc0a-44e2-9725-f5b88de59cbc tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:29:59 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-9a30f4a1-cc0a-44e2-9725-f5b88de59cbc tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:29:59 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-9a30f4a1-cc0a-44e2-9725-f5b88de59cbc tempest-CreateVolumesFromSourceVolumeTest-820234955 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:29:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9a30f4a1-cc0a-44e2-9725-f5b88de59cbc tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b6371929-6aec-4d6d-b827-f722b62fe169 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:29:59 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f8110b22-4044-4d90-ad87-b2c6d3f0683b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16485923-6eaf-4041-a194-16870ab069d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f85661d1-7c0a-4633-a2bf-473a4eea0462', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:59 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f8110b22-4044-4d90-ad87-b2c6d3f0683b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fa2dd37-53d2-45be-a238-0e06e8baea89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:29:59 devstack sudo[87529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b6371929-6aec-4d6d-b827-f722b62fe169 1073741824
Apr 02 10:29:59 devstack sudo[87529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:29:59 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-f8110b22-4044-4d90-ad87-b2c6d3f0683b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Volume volume-f85661d1-7c0a-4633-a2bf-473a4eea0462 (f85661d1-7c0a-4633-a2bf-473a4eea0462): created successfully
Apr 02 10:29:59 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f8110b22-4044-4d90-ad87-b2c6d3f0683b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fa2dd37-53d2-45be-a238-0e06e8baea89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:29:59 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f8110b22-4044-4d90-ad87-b2c6d3f0683b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Flow 'volume_create_manager' (43b6d2b1-bc4f-4d5b-9777-e355c913f689) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:29:59 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-f8110b22-4044-4d90-ad87-b2c6d3f0683b tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Created volume successfully.
Apr 02 10:30:00 devstack sudo[87529]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9a30f4a1-cc0a-44e2-9725-f5b88de59cbc tempest-CreateVolumesFromSourceVolumeTest-820234955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b6371929-6aec-4d6d-b827-f722b62fe169 1073741824" returned: 0 in 0.529s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9a30f4a1-cc0a-44e2-9725-f5b88de59cbc tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b6371929-6aec-4d6d-b827-f722b62fe169 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:00 devstack sudo[87535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b6371929-6aec-4d6d-b827-f722b62fe169
Apr 02 10:30:00 devstack sudo[87535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:00 devstack sudo[87535]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9a30f4a1-cc0a-44e2-9725-f5b88de59cbc tempest-CreateVolumesFromSourceVolumeTest-820234955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b6371929-6aec-4d6d-b827-f722b62fe169" returned: 0 in 0.478s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:00 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-9a30f4a1-cc0a-44e2-9725-f5b88de59cbc tempest-CreateVolumesFromSourceVolumeTest-820234955 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:30:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-9a30f4a1-cc0a-44e2-9725-f5b88de59cbc tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-7ededbce-c3ff-4b6d-8e44-62f35a0ee462 tempest-GroupsTest-303820755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.203s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:00 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-7ededbce-c3ff-4b6d-8e44-62f35a0ee462 tempest-GroupsTest-303820755 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c0cda9de-2ea6-45d4-acf3-7c3ef50f144d,created_at=2026-04-02T08:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1727021349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c0cda9de-2ea6-45d4-acf3-7c3ef50f144d,host='devstack@QuobyteHD#QuobyteHD',id=f2abea79-5b1f-4475-820a-951fe5743d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3e8fa7494b473c9621c99d272f55a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:29:56Z,use_quota=True,user_id='2cab7f12c1be4724aee57975c8e853b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e3932ef-1e30-4659-8986-f2dbfe9e5b0e),volume_type_id=2e3932ef-1e30-4659-8986-f2dbfe9e5b0e)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:30:00 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-7ededbce-c3ff-4b6d-8e44-62f35a0ee462 tempest-GroupsTest-303820755 None] Creating volume f2abea79-5b1f-4475-820a-951fe5743d76 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:30:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-7ededbce-c3ff-4b6d-8e44-62f35a0ee462 tempest-GroupsTest-303820755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-7ededbce-c3ff-4b6d-8e44-62f35a0ee462 tempest-GroupsTest-303820755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:00 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-7ededbce-c3ff-4b6d-8e44-62f35a0ee462 tempest-GroupsTest-303820755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:30:00 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-7ededbce-c3ff-4b6d-8e44-62f35a0ee462 tempest-GroupsTest-303820755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:30:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-7ededbce-c3ff-4b6d-8e44-62f35a0ee462 tempest-GroupsTest-303820755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:00 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-7ededbce-c3ff-4b6d-8e44-62f35a0ee462 tempest-GroupsTest-303820755 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:30:00 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-7ededbce-c3ff-4b6d-8e44-62f35a0ee462 tempest-GroupsTest-303820755 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:30:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7ededbce-c3ff-4b6d-8e44-62f35a0ee462 tempest-GroupsTest-303820755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f2abea79-5b1f-4475-820a-951fe5743d76 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:00 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9a30f4a1-cc0a-44e2-9725-f5b88de59cbc tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e45d1fa0-8e0e-419e-bc4a-64fd513ee700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6371929-6aec-4d6d-b827-f722b62fe169', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:00 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9a30f4a1-cc0a-44e2-9725-f5b88de59cbc tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0fddf2c-981b-48f2-840f-628a178cf900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:00 devstack sudo[87538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f2abea79-5b1f-4475-820a-951fe5743d76 1073741824
Apr 02 10:30:00 devstack sudo[87538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:00 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-9a30f4a1-cc0a-44e2-9725-f5b88de59cbc tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Volume volume-b6371929-6aec-4d6d-b827-f722b62fe169 (b6371929-6aec-4d6d-b827-f722b62fe169): created successfully
Apr 02 10:30:00 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9a30f4a1-cc0a-44e2-9725-f5b88de59cbc tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0fddf2c-981b-48f2-840f-628a178cf900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:00 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-9a30f4a1-cc0a-44e2-9725-f5b88de59cbc tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Flow 'volume_create_manager' (7f691103-fc4e-4c86-b2c3-ed36e0f34915) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:30:00 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-9a30f4a1-cc0a-44e2-9725-f5b88de59cbc tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Created volume successfully.
Apr 02 10:30:01 devstack sudo[87538]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7ededbce-c3ff-4b6d-8e44-62f35a0ee462 tempest-GroupsTest-303820755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f2abea79-5b1f-4475-820a-951fe5743d76 1073741824" returned: 0 in 0.552s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7ededbce-c3ff-4b6d-8e44-62f35a0ee462 tempest-GroupsTest-303820755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f2abea79-5b1f-4475-820a-951fe5743d76 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:01 devstack sudo[87544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f2abea79-5b1f-4475-820a-951fe5743d76
Apr 02 10:30:01 devstack sudo[87544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:01 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f691fc42-937f-465f-aee6-36fac5e21cd5 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Acquiring lock "cinder-b6371929-6aec-4d6d-b827-f722b62fe169-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:01 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f691fc42-937f-465f-aee6-36fac5e21cd5 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "cinder-b6371929-6aec-4d6d-b827-f722b62fe169-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:01 devstack sudo[87544]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:01 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f691fc42-937f-465f-aee6-36fac5e21cd5 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Acquiring lock "cinder-quobyte-b6371929-6aec-4d6d-b827-f722b62fe169" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7ededbce-c3ff-4b6d-8e44-62f35a0ee462 tempest-GroupsTest-303820755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f2abea79-5b1f-4475-820a-951fe5743d76" returned: 0 in 0.531s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:01 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-7ededbce-c3ff-4b6d-8e44-62f35a0ee462 tempest-GroupsTest-303820755 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:30:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-7ededbce-c3ff-4b6d-8e44-62f35a0ee462 tempest-GroupsTest-303820755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:01 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f691fc42-937f-465f-aee6-36fac5e21cd5 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "cinder-quobyte-b6371929-6aec-4d6d-b827-f722b62fe169" acquired by "delete_volume" :: waited 0.014s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7ededbce-c3ff-4b6d-8e44-62f35a0ee462 tempest-GroupsTest-303820755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db7626e2-4943-47a8-88e7-8da57d97980d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2abea79-5b1f-4475-820a-951fe5743d76', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7ededbce-c3ff-4b6d-8e44-62f35a0ee462 tempest-GroupsTest-303820755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c12299d7-ff72-48ba-bfee-29e42fa8b19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:01 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afb8bec-e64e-4bcb-939f-088ceaaaaa5b]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:30:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f691fc42-937f-465f-aee6-36fac5e21cd5 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b6371929-6aec-4d6d-b827-f722b62fe169 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:01 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-7ededbce-c3ff-4b6d-8e44-62f35a0ee462 tempest-GroupsTest-303820755 None] Volume volume-f2abea79-5b1f-4475-820a-951fe5743d76 (f2abea79-5b1f-4475-820a-951fe5743d76): created successfully
Apr 02 10:30:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7ededbce-c3ff-4b6d-8e44-62f35a0ee462 tempest-GroupsTest-303820755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c12299d7-ff72-48ba-bfee-29e42fa8b19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7ededbce-c3ff-4b6d-8e44-62f35a0ee462 tempest-GroupsTest-303820755 None] Flow 'volume_create_manager' (d4f0ce52-6240-469f-9f10-0c87f1cf1740) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:30:01 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-7ededbce-c3ff-4b6d-8e44-62f35a0ee462 tempest-GroupsTest-303820755 None] Created volume successfully.
Apr 02 10:30:01 devstack sudo[87548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b6371929-6aec-4d6d-b827-f722b62fe169
Apr 02 10:30:01 devstack sudo[87548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:02 devstack sudo[87548]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f691fc42-937f-465f-aee6-36fac5e21cd5 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b6371929-6aec-4d6d-b827-f722b62fe169" returned: 0 in 0.534s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f691fc42-937f-465f-aee6-36fac5e21cd5 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b6371929-6aec-4d6d-b827-f722b62fe169 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:02 devstack sudo[87553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b6371929-6aec-4d6d-b827-f722b62fe169
Apr 02 10:30:02 devstack sudo[87553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:02 devstack sudo[87553]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f691fc42-937f-465f-aee6-36fac5e21cd5 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b6371929-6aec-4d6d-b827-f722b62fe169" returned: 0 in 0.473s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:02 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f691fc42-937f-465f-aee6-36fac5e21cd5 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "cinder-quobyte-b6371929-6aec-4d6d-b827-f722b62fe169" released by "delete_volume" :: held 1.045s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:02 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-f691fc42-937f-465f-aee6-36fac5e21cd5 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Created reservations ['61fa1aba-5e7b-4403-ac59-226b3b23adc1', '21293bf6-f40e-4710-bc21-f83c25994f08', 'afaad479-4550-40f7-8713-5b9548e785b3', '0043e870-dfc0-4f63-85ce-b9e1149140b8'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:30:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f691fc42-937f-465f-aee6-36fac5e21cd5 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f691fc42-937f-465f-aee6-36fac5e21cd5 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:02 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f691fc42-937f-465f-aee6-36fac5e21cd5 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:30:02 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f691fc42-937f-465f-aee6-36fac5e21cd5 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:30:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f691fc42-937f-465f-aee6-36fac5e21cd5 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f691fc42-937f-465f-aee6-36fac5e21cd5 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:02 devstack sudo[87556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:30:02 devstack sudo[87556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:03 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-be54df61-5ac5-44fb-933e-9dd81ad9b337 tempest-GroupsTest-303820755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:30:03 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-be54df61-5ac5-44fb-933e-9dd81ad9b337 tempest-GroupsTest-303820755 None] Flow 'volume_create_manager' (8015ca70-87fc-4065-b701-916b0a558f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:30:03 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-be54df61-5ac5-44fb-933e-9dd81ad9b337 tempest-GroupsTest-303820755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec7b3092-0b3b-4a44-ad8a-b06478a30b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:03 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-be54df61-5ac5-44fb-933e-9dd81ad9b337 tempest-GroupsTest-303820755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec7b3092-0b3b-4a44-ad8a-b06478a30b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2041943130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c0cda9de-2ea6-45d4-acf3-7c3ef50f144d,host='devstack@QuobyteHD#QuobyteHD',id=11cc31a5-1220-4996-8f7a-7bb81709b8bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3e8fa7494b473c9621c99d272f55a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:03Z,use_quota=True,user_id='2cab7f12c1be4724aee57975c8e853b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e3932ef-1e30-4659-8986-f2dbfe9e5b0e),volume_type_id=2e3932ef-1e30-4659-8986-f2dbfe9e5b0e)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:03 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-be54df61-5ac5-44fb-933e-9dd81ad9b337 tempest-GroupsTest-303820755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ff5beb-e1b6-49b9-af7d-460dfcdc8db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:03 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-be54df61-5ac5-44fb-933e-9dd81ad9b337 tempest-GroupsTest-303820755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ff5beb-e1b6-49b9-af7d-460dfcdc8db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:03 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-be54df61-5ac5-44fb-933e-9dd81ad9b337 tempest-GroupsTest-303820755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52c06b92-7c91-4704-a39f-4e3344ccd38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:03 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-be54df61-5ac5-44fb-933e-9dd81ad9b337 tempest-GroupsTest-303820755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52c06b92-7c91-4704-a39f-4e3344ccd38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11cc31a5-1220-4996-8f7a-7bb81709b8bd', 'volume_name': 'volume-11cc31a5-1220-4996-8f7a-7bb81709b8bd', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:03 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-be54df61-5ac5-44fb-933e-9dd81ad9b337 tempest-GroupsTest-303820755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde4971e-4e35-4918-ba67-6b408e01d872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:03 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-be54df61-5ac5-44fb-933e-9dd81ad9b337 tempest-GroupsTest-303820755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde4971e-4e35-4918-ba67-6b408e01d872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:03 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-be54df61-5ac5-44fb-933e-9dd81ad9b337 tempest-GroupsTest-303820755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ceb9976-e4d4-4902-9bd0-37772d876f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:03 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-be54df61-5ac5-44fb-933e-9dd81ad9b337 tempest-GroupsTest-303820755 None] Volume 11cc31a5-1220-4996-8f7a-7bb81709b8bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11cc31a5-1220-4996-8f7a-7bb81709b8bd', 'volume_size': 1}
Apr 02 10:30:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-be54df61-5ac5-44fb-933e-9dd81ad9b337 tempest-GroupsTest-303820755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-be54df61-5ac5-44fb-933e-9dd81ad9b337 tempest-GroupsTest-303820755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:03 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-be54df61-5ac5-44fb-933e-9dd81ad9b337 tempest-GroupsTest-303820755 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c0cda9de-2ea6-45d4-acf3-7c3ef50f144d,created_at=2026-04-02T08:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2041943130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c0cda9de-2ea6-45d4-acf3-7c3ef50f144d,host='devstack@QuobyteHD#QuobyteHD',id=11cc31a5-1220-4996-8f7a-7bb81709b8bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d3e8fa7494b473c9621c99d272f55a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:03Z,use_quota=True,user_id='2cab7f12c1be4724aee57975c8e853b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e3932ef-1e30-4659-8986-f2dbfe9e5b0e),volume_type_id=2e3932ef-1e30-4659-8986-f2dbfe9e5b0e)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:30:03 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-be54df61-5ac5-44fb-933e-9dd81ad9b337 tempest-GroupsTest-303820755 None] Creating volume 11cc31a5-1220-4996-8f7a-7bb81709b8bd {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:30:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-be54df61-5ac5-44fb-933e-9dd81ad9b337 tempest-GroupsTest-303820755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-be54df61-5ac5-44fb-933e-9dd81ad9b337 tempest-GroupsTest-303820755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:03 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-be54df61-5ac5-44fb-933e-9dd81ad9b337 tempest-GroupsTest-303820755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:30:03 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-be54df61-5ac5-44fb-933e-9dd81ad9b337 tempest-GroupsTest-303820755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:30:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-be54df61-5ac5-44fb-933e-9dd81ad9b337 tempest-GroupsTest-303820755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:03 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-be54df61-5ac5-44fb-933e-9dd81ad9b337 tempest-GroupsTest-303820755 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:30:03 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-be54df61-5ac5-44fb-933e-9dd81ad9b337 tempest-GroupsTest-303820755 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:30:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-be54df61-5ac5-44fb-933e-9dd81ad9b337 tempest-GroupsTest-303820755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-11cc31a5-1220-4996-8f7a-7bb81709b8bd 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:03 devstack sudo[87558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-11cc31a5-1220-4996-8f7a-7bb81709b8bd 1073741824
Apr 02 10:30:03 devstack sudo[87558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:03 devstack sudo[87556]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f691fc42-937f-465f-aee6-36fac5e21cd5 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.452s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:03 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-f691fc42-937f-465f-aee6-36fac5e21cd5 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:30:03 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-f691fc42-937f-465f-aee6-36fac5e21cd5 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Deleted volume successfully.
Apr 02 10:30:03 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f691fc42-937f-465f-aee6-36fac5e21cd5 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "cinder-b6371929-6aec-4d6d-b827-f722b62fe169-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:03 devstack sudo[87558]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-be54df61-5ac5-44fb-933e-9dd81ad9b337 tempest-GroupsTest-303820755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-11cc31a5-1220-4996-8f7a-7bb81709b8bd 1073741824" returned: 0 in 0.552s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-be54df61-5ac5-44fb-933e-9dd81ad9b337 tempest-GroupsTest-303820755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-11cc31a5-1220-4996-8f7a-7bb81709b8bd {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:03 devstack sudo[87564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-11cc31a5-1220-4996-8f7a-7bb81709b8bd
Apr 02 10:30:03 devstack sudo[87564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:03 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-6c63e5b9-e2e0-4467-be44-c18c9bbf5eb7 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Acquiring lock "cinder-f85661d1-7c0a-4633-a2bf-473a4eea0462-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:04 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-6c63e5b9-e2e0-4467-be44-c18c9bbf5eb7 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "cinder-f85661d1-7c0a-4633-a2bf-473a4eea0462-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:04 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-6c63e5b9-e2e0-4467-be44-c18c9bbf5eb7 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Acquiring lock "cinder-quobyte-f85661d1-7c0a-4633-a2bf-473a4eea0462" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:04 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-6c63e5b9-e2e0-4467-be44-c18c9bbf5eb7 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "cinder-quobyte-f85661d1-7c0a-4633-a2bf-473a4eea0462" acquired by "delete_volume" :: waited 0.012s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:04 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e32a35-3151-4f94-8870-3b311c99b942]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:30:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6c63e5b9-e2e0-4467-be44-c18c9bbf5eb7 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f85661d1-7c0a-4633-a2bf-473a4eea0462 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:04 devstack sudo[87564]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-be54df61-5ac5-44fb-933e-9dd81ad9b337 tempest-GroupsTest-303820755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-11cc31a5-1220-4996-8f7a-7bb81709b8bd" returned: 0 in 0.455s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:04 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-be54df61-5ac5-44fb-933e-9dd81ad9b337 tempest-GroupsTest-303820755 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:30:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-be54df61-5ac5-44fb-933e-9dd81ad9b337 tempest-GroupsTest-303820755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:04 devstack sudo[87567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f85661d1-7c0a-4633-a2bf-473a4eea0462
Apr 02 10:30:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-be54df61-5ac5-44fb-933e-9dd81ad9b337 tempest-GroupsTest-303820755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ceb9976-e4d4-4902-9bd0-37772d876f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11cc31a5-1220-4996-8f7a-7bb81709b8bd', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:04 devstack sudo[87567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-be54df61-5ac5-44fb-933e-9dd81ad9b337 tempest-GroupsTest-303820755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be5f6909-4934-4ae3-9a33-f8c2a80e0202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:04 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-be54df61-5ac5-44fb-933e-9dd81ad9b337 tempest-GroupsTest-303820755 None] Volume volume-11cc31a5-1220-4996-8f7a-7bb81709b8bd (11cc31a5-1220-4996-8f7a-7bb81709b8bd): created successfully
Apr 02 10:30:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-be54df61-5ac5-44fb-933e-9dd81ad9b337 tempest-GroupsTest-303820755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be5f6909-4934-4ae3-9a33-f8c2a80e0202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-be54df61-5ac5-44fb-933e-9dd81ad9b337 tempest-GroupsTest-303820755 None] Flow 'volume_create_manager' (8015ca70-87fc-4065-b701-916b0a558f7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:30:04 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-be54df61-5ac5-44fb-933e-9dd81ad9b337 tempest-GroupsTest-303820755 None] Created volume successfully.
Apr 02 10:30:04 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab205922-3cbb-4b4c-84a9-1292f1876c8d tempest-VolumesListAdminTestJSON-1674097898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:30:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ab205922-3cbb-4b4c-84a9-1292f1876c8d tempest-VolumesListAdminTestJSON-1674097898 None] Flow 'volume_create_manager' (3a4c23f6-d968-4492-818f-4b8c0f037572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:30:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ab205922-3cbb-4b4c-84a9-1292f1876c8d tempest-VolumesListAdminTestJSON-1674097898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3397802f-3ca7-4ad1-a753-b2651bdc7472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ab205922-3cbb-4b4c-84a9-1292f1876c8d tempest-VolumesListAdminTestJSON-1674097898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3397802f-3ca7-4ad1-a753-b2651bdc7472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-813539365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97d42f51-b100-4a41-8380-e04f516769c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb825825f9364691b02e295bdf6054fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:04Z,use_quota=True,user_id='f917db6f82834c0091cf8d4c3341c3e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ab205922-3cbb-4b4c-84a9-1292f1876c8d tempest-VolumesListAdminTestJSON-1674097898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa2d2a2d-0481-4e16-b2b5-fb96db07968f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ab205922-3cbb-4b4c-84a9-1292f1876c8d tempest-VolumesListAdminTestJSON-1674097898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa2d2a2d-0481-4e16-b2b5-fb96db07968f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ab205922-3cbb-4b4c-84a9-1292f1876c8d tempest-VolumesListAdminTestJSON-1674097898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18c338d7-8ef3-42ec-a437-1a1d23db2316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ab205922-3cbb-4b4c-84a9-1292f1876c8d tempest-VolumesListAdminTestJSON-1674097898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18c338d7-8ef3-42ec-a437-1a1d23db2316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97d42f51-b100-4a41-8380-e04f516769c4', 'volume_name': 'volume-97d42f51-b100-4a41-8380-e04f516769c4', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ab205922-3cbb-4b4c-84a9-1292f1876c8d tempest-VolumesListAdminTestJSON-1674097898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98cb7d9a-a09b-47f7-9171-b52989802055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ab205922-3cbb-4b4c-84a9-1292f1876c8d tempest-VolumesListAdminTestJSON-1674097898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98cb7d9a-a09b-47f7-9171-b52989802055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ab205922-3cbb-4b4c-84a9-1292f1876c8d tempest-VolumesListAdminTestJSON-1674097898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (849e0a3f-1709-4ef4-a4f3-0137a9f29f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:04 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-ab205922-3cbb-4b4c-84a9-1292f1876c8d tempest-VolumesListAdminTestJSON-1674097898 None] Volume 97d42f51-b100-4a41-8380-e04f516769c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97d42f51-b100-4a41-8380-e04f516769c4', 'volume_size': 1}
Apr 02 10:30:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ab205922-3cbb-4b4c-84a9-1292f1876c8d tempest-VolumesListAdminTestJSON-1674097898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ab205922-3cbb-4b4c-84a9-1292f1876c8d tempest-VolumesListAdminTestJSON-1674097898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:04 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-ab205922-3cbb-4b4c-84a9-1292f1876c8d tempest-VolumesListAdminTestJSON-1674097898 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-813539365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97d42f51-b100-4a41-8380-e04f516769c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb825825f9364691b02e295bdf6054fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:04Z,use_quota=True,user_id='f917db6f82834c0091cf8d4c3341c3e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:30:04 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-ab205922-3cbb-4b4c-84a9-1292f1876c8d tempest-VolumesListAdminTestJSON-1674097898 None] Creating volume 97d42f51-b100-4a41-8380-e04f516769c4 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:30:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ab205922-3cbb-4b4c-84a9-1292f1876c8d tempest-VolumesListAdminTestJSON-1674097898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ab205922-3cbb-4b4c-84a9-1292f1876c8d tempest-VolumesListAdminTestJSON-1674097898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:04 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-ab205922-3cbb-4b4c-84a9-1292f1876c8d tempest-VolumesListAdminTestJSON-1674097898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:30:04 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-ab205922-3cbb-4b4c-84a9-1292f1876c8d tempest-VolumesListAdminTestJSON-1674097898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:30:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ab205922-3cbb-4b4c-84a9-1292f1876c8d tempest-VolumesListAdminTestJSON-1674097898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:04 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-ab205922-3cbb-4b4c-84a9-1292f1876c8d tempest-VolumesListAdminTestJSON-1674097898 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:30:04 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-ab205922-3cbb-4b4c-84a9-1292f1876c8d tempest-VolumesListAdminTestJSON-1674097898 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:30:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ab205922-3cbb-4b4c-84a9-1292f1876c8d tempest-VolumesListAdminTestJSON-1674097898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-97d42f51-b100-4a41-8380-e04f516769c4 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:04 devstack sudo[87572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-97d42f51-b100-4a41-8380-e04f516769c4 1073741824
Apr 02 10:30:04 devstack sudo[87572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:04 devstack sudo[87567]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6c63e5b9-e2e0-4467-be44-c18c9bbf5eb7 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f85661d1-7c0a-4633-a2bf-473a4eea0462" returned: 0 in 0.585s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6c63e5b9-e2e0-4467-be44-c18c9bbf5eb7 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f85661d1-7c0a-4633-a2bf-473a4eea0462 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:04 devstack sudo[87574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f85661d1-7c0a-4633-a2bf-473a4eea0462
Apr 02 10:30:04 devstack sudo[87574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:05 devstack sudo[87574]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6c63e5b9-e2e0-4467-be44-c18c9bbf5eb7 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f85661d1-7c0a-4633-a2bf-473a4eea0462" returned: 0 in 0.405s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:05 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-6c63e5b9-e2e0-4467-be44-c18c9bbf5eb7 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "cinder-quobyte-f85661d1-7c0a-4633-a2bf-473a4eea0462" released by "delete_volume" :: held 1.018s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:05 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-6c63e5b9-e2e0-4467-be44-c18c9bbf5eb7 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Created reservations ['475b3b5d-287d-4de9-a57b-752c286d941a', 'f57fd9d8-b9a9-4973-bc8b-384be318e04b', '0a552aed-188b-4e32-a4bc-8a9d652819d0', '1a1276ab-141c-44af-95bd-225ad7449795'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:30:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-6c63e5b9-e2e0-4467-be44-c18c9bbf5eb7 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-6c63e5b9-e2e0-4467-be44-c18c9bbf5eb7 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:05 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-6c63e5b9-e2e0-4467-be44-c18c9bbf5eb7 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:30:05 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-6c63e5b9-e2e0-4467-be44-c18c9bbf5eb7 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:30:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-6c63e5b9-e2e0-4467-be44-c18c9bbf5eb7 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6c63e5b9-e2e0-4467-be44-c18c9bbf5eb7 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:05 devstack sudo[87572]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ab205922-3cbb-4b4c-84a9-1292f1876c8d tempest-VolumesListAdminTestJSON-1674097898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-97d42f51-b100-4a41-8380-e04f516769c4 1073741824" returned: 0 in 0.582s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:05 devstack sudo[87580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:30:05 devstack sudo[87580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ab205922-3cbb-4b4c-84a9-1292f1876c8d tempest-VolumesListAdminTestJSON-1674097898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-97d42f51-b100-4a41-8380-e04f516769c4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:05 devstack sudo[87582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-97d42f51-b100-4a41-8380-e04f516769c4
Apr 02 10:30:05 devstack sudo[87582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:05 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-be3073d8-3cf5-4859-8bc7-526b4a35a029 tempest-GroupsTest-303820755 None] Update group completed successfully.
Apr 02 10:30:05 devstack sudo[87580]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6c63e5b9-e2e0-4467-be44-c18c9bbf5eb7 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.469s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:05 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-6c63e5b9-e2e0-4467-be44-c18c9bbf5eb7 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:30:05 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-6c63e5b9-e2e0-4467-be44-c18c9bbf5eb7 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Deleted volume successfully.
Apr 02 10:30:05 devstack sudo[87582]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ab205922-3cbb-4b4c-84a9-1292f1876c8d tempest-VolumesListAdminTestJSON-1674097898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-97d42f51-b100-4a41-8380-e04f516769c4" returned: 0 in 0.445s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:05 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-ab205922-3cbb-4b4c-84a9-1292f1876c8d tempest-VolumesListAdminTestJSON-1674097898 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:30:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ab205922-3cbb-4b4c-84a9-1292f1876c8d tempest-VolumesListAdminTestJSON-1674097898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:05 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-6c63e5b9-e2e0-4467-be44-c18c9bbf5eb7 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "cinder-f85661d1-7c0a-4633-a2bf-473a4eea0462-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:05 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ab205922-3cbb-4b4c-84a9-1292f1876c8d tempest-VolumesListAdminTestJSON-1674097898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (849e0a3f-1709-4ef4-a4f3-0137a9f29f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97d42f51-b100-4a41-8380-e04f516769c4', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:05 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ab205922-3cbb-4b4c-84a9-1292f1876c8d tempest-VolumesListAdminTestJSON-1674097898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc20d2cd-4d83-48d4-9458-a4f21f77664e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:05 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-ab205922-3cbb-4b4c-84a9-1292f1876c8d tempest-VolumesListAdminTestJSON-1674097898 None] Volume volume-97d42f51-b100-4a41-8380-e04f516769c4 (97d42f51-b100-4a41-8380-e04f516769c4): created successfully
Apr 02 10:30:05 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ab205922-3cbb-4b4c-84a9-1292f1876c8d tempest-VolumesListAdminTestJSON-1674097898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc20d2cd-4d83-48d4-9458-a4f21f77664e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:05 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ab205922-3cbb-4b4c-84a9-1292f1876c8d tempest-VolumesListAdminTestJSON-1674097898 None] Flow 'volume_create_manager' (3a4c23f6-d968-4492-818f-4b8c0f037572) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:30:05 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-ab205922-3cbb-4b4c-84a9-1292f1876c8d tempest-VolumesListAdminTestJSON-1674097898 None] Created volume successfully.
Apr 02 10:30:06 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f4e13265-67f6-45d9-84d4-ba97d044cce4 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Acquiring lock "cinder-c537ebc4-c3a1-4ca1-9305-53aa81fd6e7c-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:06 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f4e13265-67f6-45d9-84d4-ba97d044cce4 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "cinder-c537ebc4-c3a1-4ca1-9305-53aa81fd6e7c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:06 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f4e13265-67f6-45d9-84d4-ba97d044cce4 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Acquiring lock "cinder-quobyte-c537ebc4-c3a1-4ca1-9305-53aa81fd6e7c" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:06 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f4e13265-67f6-45d9-84d4-ba97d044cce4 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "cinder-quobyte-c537ebc4-c3a1-4ca1-9305-53aa81fd6e7c" acquired by "delete_volume" :: waited 0.012s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:06 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[415fec95-6918-4fbb-855d-e3fd4077fa23]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:30:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f4e13265-67f6-45d9-84d4-ba97d044cce4 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c537ebc4-c3a1-4ca1-9305-53aa81fd6e7c {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:06 devstack sudo[87586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c537ebc4-c3a1-4ca1-9305-53aa81fd6e7c
Apr 02 10:30:06 devstack sudo[87586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:06 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-b9d3e415-0af2-4130-bd9d-7adc5d3218b8 tempest-GroupsTest-303820755 None] Update group completed successfully.
Apr 02 10:30:06 devstack sudo[87586]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f4e13265-67f6-45d9-84d4-ba97d044cce4 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c537ebc4-c3a1-4ca1-9305-53aa81fd6e7c" returned: 0 in 0.583s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f4e13265-67f6-45d9-84d4-ba97d044cce4 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c537ebc4-c3a1-4ca1-9305-53aa81fd6e7c {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:06 devstack sudo[87591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c537ebc4-c3a1-4ca1-9305-53aa81fd6e7c
Apr 02 10:30:06 devstack sudo[87591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:06 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b112de1-0804-40f2-a2fc-f6dd1d0c0662 tempest-VolumesListAdminTestJSON-1674097898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:30:06 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7b112de1-0804-40f2-a2fc-f6dd1d0c0662 tempest-VolumesListAdminTestJSON-1674097898 None] Flow 'volume_create_manager' (e4288440-90c5-4297-ba47-d3fce4920c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:30:06 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7b112de1-0804-40f2-a2fc-f6dd1d0c0662 tempest-VolumesListAdminTestJSON-1674097898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa59623-4d27-4a97-8e12-51d92872d8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:06 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7b112de1-0804-40f2-a2fc-f6dd1d0c0662 tempest-VolumesListAdminTestJSON-1674097898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa59623-4d27-4a97-8e12-51d92872d8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1172447396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d819e1bc-2a2d-494e-af0c-3b2ac13f2613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb825825f9364691b02e295bdf6054fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:07Z,use_quota=True,user_id='f917db6f82834c0091cf8d4c3341c3e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:06 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7b112de1-0804-40f2-a2fc-f6dd1d0c0662 tempest-VolumesListAdminTestJSON-1674097898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ea5bbc-14d3-4995-b390-67ed2b24c9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:06 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7b112de1-0804-40f2-a2fc-f6dd1d0c0662 tempest-VolumesListAdminTestJSON-1674097898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ea5bbc-14d3-4995-b390-67ed2b24c9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:06 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7b112de1-0804-40f2-a2fc-f6dd1d0c0662 tempest-VolumesListAdminTestJSON-1674097898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a47d403e-e576-48df-b6ce-8859fe99b320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:06 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7b112de1-0804-40f2-a2fc-f6dd1d0c0662 tempest-VolumesListAdminTestJSON-1674097898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a47d403e-e576-48df-b6ce-8859fe99b320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd819e1bc-2a2d-494e-af0c-3b2ac13f2613', 'volume_name': 'volume-d819e1bc-2a2d-494e-af0c-3b2ac13f2613', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:06 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7b112de1-0804-40f2-a2fc-f6dd1d0c0662 tempest-VolumesListAdminTestJSON-1674097898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (398e9b85-bb2e-4199-990d-205c92413196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:06 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7b112de1-0804-40f2-a2fc-f6dd1d0c0662 tempest-VolumesListAdminTestJSON-1674097898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (398e9b85-bb2e-4199-990d-205c92413196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:06 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7b112de1-0804-40f2-a2fc-f6dd1d0c0662 tempest-VolumesListAdminTestJSON-1674097898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c1a0e5a-ed36-48fa-9640-f083d9638052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:06 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-7b112de1-0804-40f2-a2fc-f6dd1d0c0662 tempest-VolumesListAdminTestJSON-1674097898 None] Volume d819e1bc-2a2d-494e-af0c-3b2ac13f2613: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d819e1bc-2a2d-494e-af0c-3b2ac13f2613', 'volume_size': 1}
Apr 02 10:30:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-7b112de1-0804-40f2-a2fc-f6dd1d0c0662 tempest-VolumesListAdminTestJSON-1674097898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-7b112de1-0804-40f2-a2fc-f6dd1d0c0662 tempest-VolumesListAdminTestJSON-1674097898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:06 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-7b112de1-0804-40f2-a2fc-f6dd1d0c0662 tempest-VolumesListAdminTestJSON-1674097898 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1172447396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d819e1bc-2a2d-494e-af0c-3b2ac13f2613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb825825f9364691b02e295bdf6054fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:07Z,use_quota=True,user_id='f917db6f82834c0091cf8d4c3341c3e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:30:06 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-7b112de1-0804-40f2-a2fc-f6dd1d0c0662 tempest-VolumesListAdminTestJSON-1674097898 None] Creating volume d819e1bc-2a2d-494e-af0c-3b2ac13f2613 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:30:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-7b112de1-0804-40f2-a2fc-f6dd1d0c0662 tempest-VolumesListAdminTestJSON-1674097898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-7b112de1-0804-40f2-a2fc-f6dd1d0c0662 tempest-VolumesListAdminTestJSON-1674097898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:06 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-7b112de1-0804-40f2-a2fc-f6dd1d0c0662 tempest-VolumesListAdminTestJSON-1674097898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:30:06 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-7b112de1-0804-40f2-a2fc-f6dd1d0c0662 tempest-VolumesListAdminTestJSON-1674097898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:30:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-7b112de1-0804-40f2-a2fc-f6dd1d0c0662 tempest-VolumesListAdminTestJSON-1674097898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:06 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-7b112de1-0804-40f2-a2fc-f6dd1d0c0662 tempest-VolumesListAdminTestJSON-1674097898 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:30:06 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-7b112de1-0804-40f2-a2fc-f6dd1d0c0662 tempest-VolumesListAdminTestJSON-1674097898 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:30:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7b112de1-0804-40f2-a2fc-f6dd1d0c0662 tempest-VolumesListAdminTestJSON-1674097898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d819e1bc-2a2d-494e-af0c-3b2ac13f2613 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:06 devstack sudo[87593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d819e1bc-2a2d-494e-af0c-3b2ac13f2613 1073741824
Apr 02 10:30:06 devstack sudo[87593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:07 devstack sudo[87591]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f4e13265-67f6-45d9-84d4-ba97d044cce4 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c537ebc4-c3a1-4ca1-9305-53aa81fd6e7c" returned: 0 in 0.411s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:07 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f4e13265-67f6-45d9-84d4-ba97d044cce4 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "cinder-quobyte-c537ebc4-c3a1-4ca1-9305-53aa81fd6e7c" released by "delete_volume" :: held 1.022s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:07 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-f4e13265-67f6-45d9-84d4-ba97d044cce4 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Created reservations ['b92f83b9-b1e1-4769-a861-30351d8281eb', '2f41449a-bd1b-4d5d-b8e2-8fff80bfa6bb', 'd5707bcf-54e5-4741-b1df-dc1981370175', '5f054ae2-be3d-44b1-99ab-c65052253dc6'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:30:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f4e13265-67f6-45d9-84d4-ba97d044cce4 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f4e13265-67f6-45d9-84d4-ba97d044cce4 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:07 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f4e13265-67f6-45d9-84d4-ba97d044cce4 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:30:07 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f4e13265-67f6-45d9-84d4-ba97d044cce4 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:30:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f4e13265-67f6-45d9-84d4-ba97d044cce4 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f4e13265-67f6-45d9-84d4-ba97d044cce4 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:07 devstack sudo[87599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:30:07 devstack sudo[87599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:07 devstack sudo[87593]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7b112de1-0804-40f2-a2fc-f6dd1d0c0662 tempest-VolumesListAdminTestJSON-1674097898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d819e1bc-2a2d-494e-af0c-3b2ac13f2613 1073741824" returned: 0 in 0.568s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7b112de1-0804-40f2-a2fc-f6dd1d0c0662 tempest-VolumesListAdminTestJSON-1674097898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d819e1bc-2a2d-494e-af0c-3b2ac13f2613 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:07 devstack sudo[87601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d819e1bc-2a2d-494e-af0c-3b2ac13f2613
Apr 02 10:30:07 devstack sudo[87601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:07 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-8f3c2f77-b2ef-42d4-9b95-ab59296cac3f tempest-GroupsTest-303820755 None] Acquiring lock "cinder-quobyte-11cc31a5-1220-4996-8f7a-7bb81709b8bd" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:07 devstack sudo[87599]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:07 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-8f3c2f77-b2ef-42d4-9b95-ab59296cac3f tempest-GroupsTest-303820755 None] Lock "cinder-quobyte-11cc31a5-1220-4996-8f7a-7bb81709b8bd" acquired by "delete_volume" :: waited 0.013s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f4e13265-67f6-45d9-84d4-ba97d044cce4 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.484s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:07 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-f4e13265-67f6-45d9-84d4-ba97d044cce4 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:30:07 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-f4e13265-67f6-45d9-84d4-ba97d044cce4 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Deleted volume successfully.
Apr 02 10:30:07 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4274bf3-8d52-4290-8e74-a783e8d5da3c]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:30:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8f3c2f77-b2ef-42d4-9b95-ab59296cac3f tempest-GroupsTest-303820755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-11cc31a5-1220-4996-8f7a-7bb81709b8bd {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:07 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f4e13265-67f6-45d9-84d4-ba97d044cce4 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "cinder-c537ebc4-c3a1-4ca1-9305-53aa81fd6e7c-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:07 devstack sudo[87604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-11cc31a5-1220-4996-8f7a-7bb81709b8bd
Apr 02 10:30:07 devstack sudo[87604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:07 devstack sudo[87601]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7b112de1-0804-40f2-a2fc-f6dd1d0c0662 tempest-VolumesListAdminTestJSON-1674097898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d819e1bc-2a2d-494e-af0c-3b2ac13f2613" returned: 0 in 0.425s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-7b112de1-0804-40f2-a2fc-f6dd1d0c0662 tempest-VolumesListAdminTestJSON-1674097898 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:30:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-7b112de1-0804-40f2-a2fc-f6dd1d0c0662 tempest-VolumesListAdminTestJSON-1674097898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7b112de1-0804-40f2-a2fc-f6dd1d0c0662 tempest-VolumesListAdminTestJSON-1674097898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c1a0e5a-ed36-48fa-9640-f083d9638052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d819e1bc-2a2d-494e-af0c-3b2ac13f2613', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7b112de1-0804-40f2-a2fc-f6dd1d0c0662 tempest-VolumesListAdminTestJSON-1674097898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ae78ce-67c9-45fa-a81c-2674a2feb63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:08 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-7b112de1-0804-40f2-a2fc-f6dd1d0c0662 tempest-VolumesListAdminTestJSON-1674097898 None] Volume volume-d819e1bc-2a2d-494e-af0c-3b2ac13f2613 (d819e1bc-2a2d-494e-af0c-3b2ac13f2613): created successfully
Apr 02 10:30:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7b112de1-0804-40f2-a2fc-f6dd1d0c0662 tempest-VolumesListAdminTestJSON-1674097898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ae78ce-67c9-45fa-a81c-2674a2feb63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7b112de1-0804-40f2-a2fc-f6dd1d0c0662 tempest-VolumesListAdminTestJSON-1674097898 None] Flow 'volume_create_manager' (e4288440-90c5-4297-ba47-d3fce4920c24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:30:08 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-7b112de1-0804-40f2-a2fc-f6dd1d0c0662 tempest-VolumesListAdminTestJSON-1674097898 None] Created volume successfully.
Apr 02 10:30:08 devstack sudo[87604]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8f3c2f77-b2ef-42d4-9b95-ab59296cac3f tempest-GroupsTest-303820755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-11cc31a5-1220-4996-8f7a-7bb81709b8bd" returned: 0 in 0.483s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8f3c2f77-b2ef-42d4-9b95-ab59296cac3f tempest-GroupsTest-303820755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-11cc31a5-1220-4996-8f7a-7bb81709b8bd {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:08 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-61695dd0-4438-4ac9-a355-439dda03ad08 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Acquiring lock "cinder-71cc7649-e80f-4a62-b9d3-e9e35eb34191-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:08 devstack sudo[87610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-11cc31a5-1220-4996-8f7a-7bb81709b8bd
Apr 02 10:30:08 devstack sudo[87610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:08 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-61695dd0-4438-4ac9-a355-439dda03ad08 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "cinder-71cc7649-e80f-4a62-b9d3-e9e35eb34191-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:08 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-61695dd0-4438-4ac9-a355-439dda03ad08 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Acquiring lock "cinder-quobyte-71cc7649-e80f-4a62-b9d3-e9e35eb34191" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:08 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-61695dd0-4438-4ac9-a355-439dda03ad08 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "cinder-quobyte-71cc7649-e80f-4a62-b9d3-e9e35eb34191" acquired by "delete_volume" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:08 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[304eefc0-c267-404d-81a7-f96852f347d6]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:30:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-61695dd0-4438-4ac9-a355-439dda03ad08 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-71cc7649-e80f-4a62-b9d3-e9e35eb34191 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:08 devstack sudo[87612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-71cc7649-e80f-4a62-b9d3-e9e35eb34191
Apr 02 10:30:08 devstack sudo[87612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:08 devstack cinder-volume[82102]: DEBUG oslo_service.periodic_task [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 02 10:30:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:30:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:30:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:08 devstack sudo[87615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:30:08 devstack sudo[87615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:08 devstack sudo[87610]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8f3c2f77-b2ef-42d4-9b95-ab59296cac3f tempest-GroupsTest-303820755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-11cc31a5-1220-4996-8f7a-7bb81709b8bd" returned: 0 in 0.477s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:08 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-8f3c2f77-b2ef-42d4-9b95-ab59296cac3f tempest-GroupsTest-303820755 None] Lock "cinder-quobyte-11cc31a5-1220-4996-8f7a-7bb81709b8bd" released by "delete_volume" :: held 1.001s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:08 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-8f3c2f77-b2ef-42d4-9b95-ab59296cac3f tempest-GroupsTest-303820755 None] Acquiring lock "cinder-quobyte-f2abea79-5b1f-4475-820a-951fe5743d76" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:08 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-8f3c2f77-b2ef-42d4-9b95-ab59296cac3f tempest-GroupsTest-303820755 None] Lock "cinder-quobyte-f2abea79-5b1f-4475-820a-951fe5743d76" acquired by "delete_volume" :: waited 0.007s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:08 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1d397e-0f23-42b7-98d6-362c5a74d65b]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:30:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8f3c2f77-b2ef-42d4-9b95-ab59296cac3f tempest-GroupsTest-303820755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f2abea79-5b1f-4475-820a-951fe5743d76 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:08 devstack sudo[87618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f2abea79-5b1f-4475-820a-951fe5743d76
Apr 02 10:30:08 devstack sudo[87618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:09 devstack sudo[87612]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-61695dd0-4438-4ac9-a355-439dda03ad08 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-71cc7649-e80f-4a62-b9d3-e9e35eb34191" returned: 0 in 0.584s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-61695dd0-4438-4ac9-a355-439dda03ad08 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-71cc7649-e80f-4a62-b9d3-e9e35eb34191 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:09 devstack sudo[87624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-71cc7649-e80f-4a62-b9d3-e9e35eb34191
Apr 02 10:30:09 devstack sudo[87624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:09 devstack sudo[87615]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.441s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-f827d923-8d80-4c89-ae90-1b3485f99a87 tempest-VolumesListAdminTestJSON-1674097898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f827d923-8d80-4c89-ae90-1b3485f99a87 tempest-VolumesListAdminTestJSON-1674097898 None] Flow 'volume_create_manager' (79d689a1-56a7-455b-bdf2-13148072208d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f827d923-8d80-4c89-ae90-1b3485f99a87 tempest-VolumesListAdminTestJSON-1674097898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d8e1a5-b42f-4f22-a845-e815d45e4bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f827d923-8d80-4c89-ae90-1b3485f99a87 tempest-VolumesListAdminTestJSON-1674097898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d8e1a5-b42f-4f22-a845-e815d45e4bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-604521052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=661bd1f5-9287-4f9f-a94d-77141a83e710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb825825f9364691b02e295bdf6054fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:09Z,use_quota=True,user_id='f917db6f82834c0091cf8d4c3341c3e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f827d923-8d80-4c89-ae90-1b3485f99a87 tempest-VolumesListAdminTestJSON-1674097898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb62ef8e-7e7d-45e7-8ef2-9912856a0e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f827d923-8d80-4c89-ae90-1b3485f99a87 tempest-VolumesListAdminTestJSON-1674097898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb62ef8e-7e7d-45e7-8ef2-9912856a0e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f827d923-8d80-4c89-ae90-1b3485f99a87 tempest-VolumesListAdminTestJSON-1674097898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85b88a7b-5e8a-4788-89e9-61712572e542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f827d923-8d80-4c89-ae90-1b3485f99a87 tempest-VolumesListAdminTestJSON-1674097898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85b88a7b-5e8a-4788-89e9-61712572e542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '661bd1f5-9287-4f9f-a94d-77141a83e710', 'volume_name': 'volume-661bd1f5-9287-4f9f-a94d-77141a83e710', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f827d923-8d80-4c89-ae90-1b3485f99a87 tempest-VolumesListAdminTestJSON-1674097898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d246fe-32e3-43f1-bca4-4d81908c9cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f827d923-8d80-4c89-ae90-1b3485f99a87 tempest-VolumesListAdminTestJSON-1674097898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d246fe-32e3-43f1-bca4-4d81908c9cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f827d923-8d80-4c89-ae90-1b3485f99a87 tempest-VolumesListAdminTestJSON-1674097898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (545a5262-0d38-42e5-bf19-bc40ec06817b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:09 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-f827d923-8d80-4c89-ae90-1b3485f99a87 tempest-VolumesListAdminTestJSON-1674097898 None] Volume 661bd1f5-9287-4f9f-a94d-77141a83e710: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-661bd1f5-9287-4f9f-a94d-77141a83e710', 'volume_size': 1}
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f827d923-8d80-4c89-ae90-1b3485f99a87 tempest-VolumesListAdminTestJSON-1674097898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f827d923-8d80-4c89-ae90-1b3485f99a87 tempest-VolumesListAdminTestJSON-1674097898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f827d923-8d80-4c89-ae90-1b3485f99a87 tempest-VolumesListAdminTestJSON-1674097898 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-604521052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=661bd1f5-9287-4f9f-a94d-77141a83e710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb825825f9364691b02e295bdf6054fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:09Z,use_quota=True,user_id='f917db6f82834c0091cf8d4c3341c3e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-f827d923-8d80-4c89-ae90-1b3485f99a87 tempest-VolumesListAdminTestJSON-1674097898 None] Creating volume 661bd1f5-9287-4f9f-a94d-77141a83e710 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f827d923-8d80-4c89-ae90-1b3485f99a87 tempest-VolumesListAdminTestJSON-1674097898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f827d923-8d80-4c89-ae90-1b3485f99a87 tempest-VolumesListAdminTestJSON-1674097898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f827d923-8d80-4c89-ae90-1b3485f99a87 tempest-VolumesListAdminTestJSON-1674097898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f827d923-8d80-4c89-ae90-1b3485f99a87 tempest-VolumesListAdminTestJSON-1674097898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f827d923-8d80-4c89-ae90-1b3485f99a87 tempest-VolumesListAdminTestJSON-1674097898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f827d923-8d80-4c89-ae90-1b3485f99a87 tempest-VolumesListAdminTestJSON-1674097898 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:30:09 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-f827d923-8d80-4c89-ae90-1b3485f99a87 tempest-VolumesListAdminTestJSON-1674097898 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f827d923-8d80-4c89-ae90-1b3485f99a87 tempest-VolumesListAdminTestJSON-1674097898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-661bd1f5-9287-4f9f-a94d-77141a83e710 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:09 devstack sudo[87629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-661bd1f5-9287-4f9f-a94d-77141a83e710 1073741824
Apr 02 10:30:09 devstack sudo[87629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:09 devstack sudo[87618]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8f3c2f77-b2ef-42d4-9b95-ab59296cac3f tempest-GroupsTest-303820755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f2abea79-5b1f-4475-820a-951fe5743d76" returned: 0 in 0.584s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8f3c2f77-b2ef-42d4-9b95-ab59296cac3f tempest-GroupsTest-303820755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f2abea79-5b1f-4475-820a-951fe5743d76 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:09 devstack sudo[87632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f2abea79-5b1f-4475-820a-951fe5743d76
Apr 02 10:30:09 devstack sudo[87632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:09 devstack sudo[87624]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-61695dd0-4438-4ac9-a355-439dda03ad08 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-71cc7649-e80f-4a62-b9d3-e9e35eb34191" returned: 0 in 0.470s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-61695dd0-4438-4ac9-a355-439dda03ad08 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "cinder-quobyte-71cc7649-e80f-4a62-b9d3-e9e35eb34191" released by "delete_volume" :: held 1.078s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-61695dd0-4438-4ac9-a355-439dda03ad08 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Created reservations ['d1e52428-f828-4403-aa7d-153fc7be747a', '21ee58d4-6500-43f1-bbde-9b3fbb72afe3', '1041b5e7-b522-41bb-b279-c00479519b3b', 'a50dd907-9b1e-46b5-970d-345c00704229'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-61695dd0-4438-4ac9-a355-439dda03ad08 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-61695dd0-4438-4ac9-a355-439dda03ad08 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-61695dd0-4438-4ac9-a355-439dda03ad08 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-61695dd0-4438-4ac9-a355-439dda03ad08 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-61695dd0-4438-4ac9-a355-439dda03ad08 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-61695dd0-4438-4ac9-a355-439dda03ad08 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:09 devstack sudo[87634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:30:09 devstack sudo[87634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:09 devstack sudo[87632]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8f3c2f77-b2ef-42d4-9b95-ab59296cac3f tempest-GroupsTest-303820755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f2abea79-5b1f-4475-820a-951fe5743d76" returned: 0 in 0.446s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-8f3c2f77-b2ef-42d4-9b95-ab59296cac3f tempest-GroupsTest-303820755 None] Lock "cinder-quobyte-f2abea79-5b1f-4475-820a-951fe5743d76" released by "delete_volume" :: held 1.053s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-8f3c2f77-b2ef-42d4-9b95-ab59296cac3f tempest-GroupsTest-303820755 None] Created reservations ['cb84f704-f490-4b9d-947c-9062ba183b82'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:30:09 devstack sudo[87629]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:09 devstack cinder-volume[82102]: WARNING cinder.quota [None req-8f3c2f77-b2ef-42d4-9b95-ab59296cac3f tempest-GroupsTest-303820755 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-805599917 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-805599917, it is now deprecated. Please use the default quota class for default quota.
Apr 02 10:30:09 devstack cinder-volume[82102]: WARNING cinder.quota [None req-8f3c2f77-b2ef-42d4-9b95-ab59296cac3f tempest-GroupsTest-303820755 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-805599917 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-805599917, it is now deprecated. Please use the default quota class for default quota.
Apr 02 10:30:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f827d923-8d80-4c89-ae90-1b3485f99a87 tempest-VolumesListAdminTestJSON-1674097898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-661bd1f5-9287-4f9f-a94d-77141a83e710 1073741824" returned: 0 in 0.574s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:10 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-8f3c2f77-b2ef-42d4-9b95-ab59296cac3f tempest-GroupsTest-303820755 None] Created reservations ['c8204d78-c592-4d86-aed1-a752bbeaa6a2', '4d91ab60-4157-4a9d-93a2-6c657f06490f', '54e74862-0112-4ea3-bdfe-18526a601fa5', '8b587a98-c1a9-4c35-a868-c4640c72f652'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:30:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f827d923-8d80-4c89-ae90-1b3485f99a87 tempest-VolumesListAdminTestJSON-1674097898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-661bd1f5-9287-4f9f-a94d-77141a83e710 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:10 devstack sudo[87641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-661bd1f5-9287-4f9f-a94d-77141a83e710
Apr 02 10:30:10 devstack sudo[87641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:10 devstack sudo[87634]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-61695dd0-4438-4ac9-a355-439dda03ad08 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.489s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:10 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-61695dd0-4438-4ac9-a355-439dda03ad08 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:30:10 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-8f3c2f77-b2ef-42d4-9b95-ab59296cac3f tempest-GroupsTest-303820755 None] Created reservations ['e3479458-e87d-4ba1-8af9-ef699164455e', 'adc46279-53f8-4f7b-93ce-897a5f6ca266', 'bddda774-8497-45b9-a5c3-b50ff0b24090', 'b4984e9e-cd46-47fd-8878-a614d11b8935'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:30:10 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-61695dd0-4438-4ac9-a355-439dda03ad08 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Deleted volume successfully.
Apr 02 10:30:10 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-61695dd0-4438-4ac9-a355-439dda03ad08 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "cinder-71cc7649-e80f-4a62-b9d3-e9e35eb34191-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8f3c2f77-b2ef-42d4-9b95-ab59296cac3f tempest-GroupsTest-303820755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8f3c2f77-b2ef-42d4-9b95-ab59296cac3f tempest-GroupsTest-303820755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:10 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8f3c2f77-b2ef-42d4-9b95-ab59296cac3f tempest-GroupsTest-303820755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:30:10 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8f3c2f77-b2ef-42d4-9b95-ab59296cac3f tempest-GroupsTest-303820755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:30:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8f3c2f77-b2ef-42d4-9b95-ab59296cac3f tempest-GroupsTest-303820755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8f3c2f77-b2ef-42d4-9b95-ab59296cac3f tempest-GroupsTest-303820755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:10 devstack sudo[87643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:30:10 devstack sudo[87643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:10 devstack sudo[87641]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f827d923-8d80-4c89-ae90-1b3485f99a87 tempest-VolumesListAdminTestJSON-1674097898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-661bd1f5-9287-4f9f-a94d-77141a83e710" returned: 0 in 0.430s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:10 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f827d923-8d80-4c89-ae90-1b3485f99a87 tempest-VolumesListAdminTestJSON-1674097898 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:30:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f827d923-8d80-4c89-ae90-1b3485f99a87 tempest-VolumesListAdminTestJSON-1674097898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f827d923-8d80-4c89-ae90-1b3485f99a87 tempest-VolumesListAdminTestJSON-1674097898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (545a5262-0d38-42e5-bf19-bc40ec06817b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-661bd1f5-9287-4f9f-a94d-77141a83e710', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f827d923-8d80-4c89-ae90-1b3485f99a87 tempest-VolumesListAdminTestJSON-1674097898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96e2aa55-7a13-41c1-a68c-e07bcf3be3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:10 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-f827d923-8d80-4c89-ae90-1b3485f99a87 tempest-VolumesListAdminTestJSON-1674097898 None] Volume volume-661bd1f5-9287-4f9f-a94d-77141a83e710 (661bd1f5-9287-4f9f-a94d-77141a83e710): created successfully
Apr 02 10:30:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f827d923-8d80-4c89-ae90-1b3485f99a87 tempest-VolumesListAdminTestJSON-1674097898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96e2aa55-7a13-41c1-a68c-e07bcf3be3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f827d923-8d80-4c89-ae90-1b3485f99a87 tempest-VolumesListAdminTestJSON-1674097898 None] Flow 'volume_create_manager' (79d689a1-56a7-455b-bdf2-13148072208d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:30:10 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-f827d923-8d80-4c89-ae90-1b3485f99a87 tempest-VolumesListAdminTestJSON-1674097898 None] Created volume successfully.
Apr 02 10:30:10 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-d80d2f31-c44a-4922-a24c-f78e2892b9ff tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Acquiring lock "cinder-9670af2a-d9d5-4242-a7f2-b43cb314176a-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:10 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-d80d2f31-c44a-4922-a24c-f78e2892b9ff tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "cinder-9670af2a-d9d5-4242-a7f2-b43cb314176a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:10 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-d80d2f31-c44a-4922-a24c-f78e2892b9ff tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Acquiring lock "cinder-quobyte-9670af2a-d9d5-4242-a7f2-b43cb314176a" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:10 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-d80d2f31-c44a-4922-a24c-f78e2892b9ff tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "cinder-quobyte-9670af2a-d9d5-4242-a7f2-b43cb314176a" acquired by "delete_volume" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:10 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb72434-50a1-4e50-b7a6-1b445df664e4]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:30:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d80d2f31-c44a-4922-a24c-f78e2892b9ff tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9670af2a-d9d5-4242-a7f2-b43cb314176a {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:10 devstack sudo[87647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9670af2a-d9d5-4242-a7f2-b43cb314176a
Apr 02 10:30:10 devstack sudo[87647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:10 devstack sudo[87643]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8f3c2f77-b2ef-42d4-9b95-ab59296cac3f tempest-GroupsTest-303820755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.520s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:10 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-8f3c2f77-b2ef-42d4-9b95-ab59296cac3f tempest-GroupsTest-303820755 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:30:10 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-8f3c2f77-b2ef-42d4-9b95-ab59296cac3f tempest-GroupsTest-303820755 None] Delete group completed successfully.
Apr 02 10:30:11 devstack sudo[87647]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d80d2f31-c44a-4922-a24c-f78e2892b9ff tempest-CreateVolumesFromSourceVolumeTest-820234955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9670af2a-d9d5-4242-a7f2-b43cb314176a" returned: 0 in 0.484s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d80d2f31-c44a-4922-a24c-f78e2892b9ff tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9670af2a-d9d5-4242-a7f2-b43cb314176a {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:11 devstack sudo[87653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9670af2a-d9d5-4242-a7f2-b43cb314176a
Apr 02 10:30:11 devstack sudo[87653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:11 devstack sudo[87653]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d80d2f31-c44a-4922-a24c-f78e2892b9ff tempest-CreateVolumesFromSourceVolumeTest-820234955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9670af2a-d9d5-4242-a7f2-b43cb314176a" returned: 0 in 0.455s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:11 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-d80d2f31-c44a-4922-a24c-f78e2892b9ff tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "cinder-quobyte-9670af2a-d9d5-4242-a7f2-b43cb314176a" released by "delete_volume" :: held 0.965s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:11 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-d80d2f31-c44a-4922-a24c-f78e2892b9ff tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Created reservations ['8b8ff744-e6ef-4d44-aba5-d059aaca29c9', '890c00ae-b894-4ff6-95b3-5494bf5aa16f', '8f285f0a-b7b1-4cb6-aec2-f5fc6c3aeb66', '75ff8842-8cbe-427b-8581-837f2df5f138'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:30:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d80d2f31-c44a-4922-a24c-f78e2892b9ff tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d80d2f31-c44a-4922-a24c-f78e2892b9ff tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:11 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d80d2f31-c44a-4922-a24c-f78e2892b9ff tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:30:11 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d80d2f31-c44a-4922-a24c-f78e2892b9ff tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:30:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d80d2f31-c44a-4922-a24c-f78e2892b9ff tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d80d2f31-c44a-4922-a24c-f78e2892b9ff tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:11 devstack sudo[87656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:30:11 devstack sudo[87656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:12 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa75e1ad-0ce6-4369-b2ce-a6380940a434 tempest-VolumesListAdminTestJSON-1635913052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:30:12 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-fa75e1ad-0ce6-4369-b2ce-a6380940a434 tempest-VolumesListAdminTestJSON-1635913052 None] Flow 'volume_create_manager' (f8977db3-0432-46c2-b4f3-ad9ff20eaad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:30:12 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-fa75e1ad-0ce6-4369-b2ce-a6380940a434 tempest-VolumesListAdminTestJSON-1635913052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (122ae155-8a65-4770-87aa-4ec1f8d0047c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:12 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-fa75e1ad-0ce6-4369-b2ce-a6380940a434 tempest-VolumesListAdminTestJSON-1635913052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (122ae155-8a65-4770-87aa-4ec1f8d0047c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9323625-320d-49a1-9244-82390597147d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01401e5370804c96a63fd12d1a81cd91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:12Z,use_quota=True,user_id='bf68ff3751df4dd795a006f3a7e8b6bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:12 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-fa75e1ad-0ce6-4369-b2ce-a6380940a434 tempest-VolumesListAdminTestJSON-1635913052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b71c4a0e-b69a-480c-80d3-c005f0c86195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:12 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-fa75e1ad-0ce6-4369-b2ce-a6380940a434 tempest-VolumesListAdminTestJSON-1635913052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b71c4a0e-b69a-480c-80d3-c005f0c86195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:12 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-fa75e1ad-0ce6-4369-b2ce-a6380940a434 tempest-VolumesListAdminTestJSON-1635913052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a7b917-728f-452b-833b-74b34cab1109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:12 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-fa75e1ad-0ce6-4369-b2ce-a6380940a434 tempest-VolumesListAdminTestJSON-1635913052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a7b917-728f-452b-833b-74b34cab1109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9323625-320d-49a1-9244-82390597147d', 'volume_name': 'volume-a9323625-320d-49a1-9244-82390597147d', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:12 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-fa75e1ad-0ce6-4369-b2ce-a6380940a434 tempest-VolumesListAdminTestJSON-1635913052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b49b057d-8b47-4f07-bdff-1ea221904980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:12 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-fa75e1ad-0ce6-4369-b2ce-a6380940a434 tempest-VolumesListAdminTestJSON-1635913052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b49b057d-8b47-4f07-bdff-1ea221904980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:12 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-fa75e1ad-0ce6-4369-b2ce-a6380940a434 tempest-VolumesListAdminTestJSON-1635913052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b12dcde-da3d-476f-bc96-8894b26285b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:12 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-fa75e1ad-0ce6-4369-b2ce-a6380940a434 tempest-VolumesListAdminTestJSON-1635913052 None] Volume a9323625-320d-49a1-9244-82390597147d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9323625-320d-49a1-9244-82390597147d', 'volume_size': 1}
Apr 02 10:30:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-fa75e1ad-0ce6-4369-b2ce-a6380940a434 tempest-VolumesListAdminTestJSON-1635913052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-fa75e1ad-0ce6-4369-b2ce-a6380940a434 tempest-VolumesListAdminTestJSON-1635913052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:12 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-fa75e1ad-0ce6-4369-b2ce-a6380940a434 tempest-VolumesListAdminTestJSON-1635913052 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9323625-320d-49a1-9244-82390597147d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01401e5370804c96a63fd12d1a81cd91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:12Z,use_quota=True,user_id='bf68ff3751df4dd795a006f3a7e8b6bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:30:12 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-fa75e1ad-0ce6-4369-b2ce-a6380940a434 tempest-VolumesListAdminTestJSON-1635913052 None] Creating volume a9323625-320d-49a1-9244-82390597147d {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:30:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-fa75e1ad-0ce6-4369-b2ce-a6380940a434 tempest-VolumesListAdminTestJSON-1635913052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-fa75e1ad-0ce6-4369-b2ce-a6380940a434 tempest-VolumesListAdminTestJSON-1635913052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:12 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-fa75e1ad-0ce6-4369-b2ce-a6380940a434 tempest-VolumesListAdminTestJSON-1635913052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:30:12 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-fa75e1ad-0ce6-4369-b2ce-a6380940a434 tempest-VolumesListAdminTestJSON-1635913052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:30:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-fa75e1ad-0ce6-4369-b2ce-a6380940a434 tempest-VolumesListAdminTestJSON-1635913052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:12 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-fa75e1ad-0ce6-4369-b2ce-a6380940a434 tempest-VolumesListAdminTestJSON-1635913052 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:30:12 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-fa75e1ad-0ce6-4369-b2ce-a6380940a434 tempest-VolumesListAdminTestJSON-1635913052 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:30:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-fa75e1ad-0ce6-4369-b2ce-a6380940a434 tempest-VolumesListAdminTestJSON-1635913052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a9323625-320d-49a1-9244-82390597147d 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:12 devstack sudo[87656]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d80d2f31-c44a-4922-a24c-f78e2892b9ff tempest-CreateVolumesFromSourceVolumeTest-820234955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.516s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:12 devstack sudo[87659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a9323625-320d-49a1-9244-82390597147d 1073741824
Apr 02 10:30:12 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-d80d2f31-c44a-4922-a24c-f78e2892b9ff tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:30:12 devstack sudo[87659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:12 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-d80d2f31-c44a-4922-a24c-f78e2892b9ff tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Deleted volume successfully.
Apr 02 10:30:12 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-d80d2f31-c44a-4922-a24c-f78e2892b9ff tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "cinder-9670af2a-d9d5-4242-a7f2-b43cb314176a-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:12 devstack sudo[87659]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:12 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-e4a119c2-e65b-4cd9-910c-269ff2925b92 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Acquiring lock "cinder-07acbdcc-e88c-4f3a-a609-50136eda53ee-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-fa75e1ad-0ce6-4369-b2ce-a6380940a434 tempest-VolumesListAdminTestJSON-1635913052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a9323625-320d-49a1-9244-82390597147d 1073741824" returned: 0 in 0.565s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:12 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-e4a119c2-e65b-4cd9-910c-269ff2925b92 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "cinder-07acbdcc-e88c-4f3a-a609-50136eda53ee-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-fa75e1ad-0ce6-4369-b2ce-a6380940a434 tempest-VolumesListAdminTestJSON-1635913052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a9323625-320d-49a1-9244-82390597147d {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:12 devstack sudo[87664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a9323625-320d-49a1-9244-82390597147d
Apr 02 10:30:12 devstack sudo[87664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:12 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-e4a119c2-e65b-4cd9-910c-269ff2925b92 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Acquiring lock "cinder-quobyte-07acbdcc-e88c-4f3a-a609-50136eda53ee" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:12 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-e4a119c2-e65b-4cd9-910c-269ff2925b92 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "cinder-quobyte-07acbdcc-e88c-4f3a-a609-50136eda53ee" acquired by "delete_volume" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:12 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89ba95a-6c95-48e1-9ba6-639600164e03]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:30:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e4a119c2-e65b-4cd9-910c-269ff2925b92 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-07acbdcc-e88c-4f3a-a609-50136eda53ee {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:12 devstack sudo[87666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-07acbdcc-e88c-4f3a-a609-50136eda53ee
Apr 02 10:30:12 devstack sudo[87666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:13 devstack sudo[87664]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-fa75e1ad-0ce6-4369-b2ce-a6380940a434 tempest-VolumesListAdminTestJSON-1635913052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a9323625-320d-49a1-9244-82390597147d" returned: 0 in 0.440s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:13 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-fa75e1ad-0ce6-4369-b2ce-a6380940a434 tempest-VolumesListAdminTestJSON-1635913052 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:30:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-fa75e1ad-0ce6-4369-b2ce-a6380940a434 tempest-VolumesListAdminTestJSON-1635913052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:13 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-fa75e1ad-0ce6-4369-b2ce-a6380940a434 tempest-VolumesListAdminTestJSON-1635913052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b12dcde-da3d-476f-bc96-8894b26285b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9323625-320d-49a1-9244-82390597147d', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:13 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-fa75e1ad-0ce6-4369-b2ce-a6380940a434 tempest-VolumesListAdminTestJSON-1635913052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e0841bb-c579-4916-8a1c-4baa47ae3c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:13 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-fa75e1ad-0ce6-4369-b2ce-a6380940a434 tempest-VolumesListAdminTestJSON-1635913052 None] Volume volume-a9323625-320d-49a1-9244-82390597147d (a9323625-320d-49a1-9244-82390597147d): created successfully
Apr 02 10:30:13 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-fa75e1ad-0ce6-4369-b2ce-a6380940a434 tempest-VolumesListAdminTestJSON-1635913052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e0841bb-c579-4916-8a1c-4baa47ae3c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:13 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-fa75e1ad-0ce6-4369-b2ce-a6380940a434 tempest-VolumesListAdminTestJSON-1635913052 None] Flow 'volume_create_manager' (f8977db3-0432-46c2-b4f3-ad9ff20eaad5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:30:13 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-fa75e1ad-0ce6-4369-b2ce-a6380940a434 tempest-VolumesListAdminTestJSON-1635913052 None] Created volume successfully.
Apr 02 10:30:13 devstack sudo[87666]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e4a119c2-e65b-4cd9-910c-269ff2925b92 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-07acbdcc-e88c-4f3a-a609-50136eda53ee" returned: 0 in 0.553s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e4a119c2-e65b-4cd9-910c-269ff2925b92 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-07acbdcc-e88c-4f3a-a609-50136eda53ee {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:13 devstack sudo[87672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-07acbdcc-e88c-4f3a-a609-50136eda53ee
Apr 02 10:30:13 devstack sudo[87672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:13 devstack sudo[87672]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e4a119c2-e65b-4cd9-910c-269ff2925b92 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-07acbdcc-e88c-4f3a-a609-50136eda53ee" returned: 0 in 0.421s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:13 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-e4a119c2-e65b-4cd9-910c-269ff2925b92 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "cinder-quobyte-07acbdcc-e88c-4f3a-a609-50136eda53ee" released by "delete_volume" :: held 1.000s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:13 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-e4a119c2-e65b-4cd9-910c-269ff2925b92 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Created reservations ['59caa82c-71b1-4e03-b7ec-9cb9aa24b092', 'f62c377d-d811-4810-ae9c-6ca7e677555d', '27fff524-ce96-4fc5-b575-feefa06cc733', 'ec13b6cc-457a-4b71-b3b2-e4d099c65f55'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:30:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e4a119c2-e65b-4cd9-910c-269ff2925b92 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e4a119c2-e65b-4cd9-910c-269ff2925b92 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:13 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e4a119c2-e65b-4cd9-910c-269ff2925b92 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:30:13 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e4a119c2-e65b-4cd9-910c-269ff2925b92 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:30:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e4a119c2-e65b-4cd9-910c-269ff2925b92 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e4a119c2-e65b-4cd9-910c-269ff2925b92 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:13 devstack sudo[87675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:30:13 devstack sudo[87675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:14 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-eeb0cbcd-c204-4c6c-8a88-bf39ba21a501 tempest-VolumesListAdminTestJSON-1635913052 None] Acquiring lock "cinder-a9323625-320d-49a1-9244-82390597147d-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:14 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-eeb0cbcd-c204-4c6c-8a88-bf39ba21a501 tempest-VolumesListAdminTestJSON-1635913052 None] Lock "cinder-a9323625-320d-49a1-9244-82390597147d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:14 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-eeb0cbcd-c204-4c6c-8a88-bf39ba21a501 tempest-VolumesListAdminTestJSON-1635913052 None] Acquiring lock "cinder-quobyte-a9323625-320d-49a1-9244-82390597147d" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:14 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-eeb0cbcd-c204-4c6c-8a88-bf39ba21a501 tempest-VolumesListAdminTestJSON-1635913052 None] Lock "cinder-quobyte-a9323625-320d-49a1-9244-82390597147d" acquired by "delete_volume" :: waited 0.029s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:14 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8afef1c-f8e2-46f8-b8c4-3734321032a3]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:30:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-eeb0cbcd-c204-4c6c-8a88-bf39ba21a501 tempest-VolumesListAdminTestJSON-1635913052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a9323625-320d-49a1-9244-82390597147d {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:14 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a12d0ac7-ee70-4f5d-8d34-af6e97cf723b tempest-VolumesListAdminTestJSON-1674097898 None] Acquiring lock "cinder-661bd1f5-9287-4f9f-a94d-77141a83e710-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:14 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a12d0ac7-ee70-4f5d-8d34-af6e97cf723b tempest-VolumesListAdminTestJSON-1674097898 None] Lock "cinder-661bd1f5-9287-4f9f-a94d-77141a83e710-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:14 devstack sudo[87675]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e4a119c2-e65b-4cd9-910c-269ff2925b92 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.507s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:14 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-e4a119c2-e65b-4cd9-910c-269ff2925b92 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:30:14 devstack sudo[87678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a9323625-320d-49a1-9244-82390597147d
Apr 02 10:30:14 devstack sudo[87678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:14 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-e4a119c2-e65b-4cd9-910c-269ff2925b92 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Deleted volume successfully.
Apr 02 10:30:14 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a12d0ac7-ee70-4f5d-8d34-af6e97cf723b tempest-VolumesListAdminTestJSON-1674097898 None] Acquiring lock "cinder-quobyte-661bd1f5-9287-4f9f-a94d-77141a83e710" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:14 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-e4a119c2-e65b-4cd9-910c-269ff2925b92 tempest-CreateVolumesFromSourceVolumeTest-820234955 None] Lock "cinder-07acbdcc-e88c-4f3a-a609-50136eda53ee-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:14 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a12d0ac7-ee70-4f5d-8d34-af6e97cf723b tempest-VolumesListAdminTestJSON-1674097898 None] Lock "cinder-quobyte-661bd1f5-9287-4f9f-a94d-77141a83e710" acquired by "delete_volume" :: waited 0.012s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:14 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bab3f9c-6462-4556-ad37-3cd6718988b0]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:30:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a12d0ac7-ee70-4f5d-8d34-af6e97cf723b tempest-VolumesListAdminTestJSON-1674097898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-661bd1f5-9287-4f9f-a94d-77141a83e710 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:14 devstack sudo[87680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-661bd1f5-9287-4f9f-a94d-77141a83e710
Apr 02 10:30:14 devstack sudo[87680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:14 devstack sudo[87678]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-eeb0cbcd-c204-4c6c-8a88-bf39ba21a501 tempest-VolumesListAdminTestJSON-1635913052 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a9323625-320d-49a1-9244-82390597147d" returned: 0 in 0.556s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-eeb0cbcd-c204-4c6c-8a88-bf39ba21a501 tempest-VolumesListAdminTestJSON-1635913052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a9323625-320d-49a1-9244-82390597147d {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:14 devstack sudo[87685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a9323625-320d-49a1-9244-82390597147d
Apr 02 10:30:14 devstack sudo[87685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:15 devstack sudo[87680]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a12d0ac7-ee70-4f5d-8d34-af6e97cf723b tempest-VolumesListAdminTestJSON-1674097898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-661bd1f5-9287-4f9f-a94d-77141a83e710" returned: 0 in 0.610s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a12d0ac7-ee70-4f5d-8d34-af6e97cf723b tempest-VolumesListAdminTestJSON-1674097898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-661bd1f5-9287-4f9f-a94d-77141a83e710 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:15 devstack sudo[87690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-661bd1f5-9287-4f9f-a94d-77141a83e710
Apr 02 10:30:15 devstack sudo[87690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:15 devstack sudo[87685]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-eeb0cbcd-c204-4c6c-8a88-bf39ba21a501 tempest-VolumesListAdminTestJSON-1635913052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a9323625-320d-49a1-9244-82390597147d" returned: 0 in 0.496s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:15 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-eeb0cbcd-c204-4c6c-8a88-bf39ba21a501 tempest-VolumesListAdminTestJSON-1635913052 None] Lock "cinder-quobyte-a9323625-320d-49a1-9244-82390597147d" released by "delete_volume" :: held 1.078s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:15 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-eeb0cbcd-c204-4c6c-8a88-bf39ba21a501 tempest-VolumesListAdminTestJSON-1635913052 None] Created reservations ['85ecd292-00ee-4be1-afd9-7436a44bdb5c', '9cba0920-2c62-469b-8aad-e5af66337473', 'cfb4551a-f42f-4739-bc16-0f2ff6b1c5ae', 'b161b7b0-3a16-49a4-ad69-5fbe2370d34e'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:30:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-eeb0cbcd-c204-4c6c-8a88-bf39ba21a501 tempest-VolumesListAdminTestJSON-1635913052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-eeb0cbcd-c204-4c6c-8a88-bf39ba21a501 tempest-VolumesListAdminTestJSON-1635913052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-eeb0cbcd-c204-4c6c-8a88-bf39ba21a501 tempest-VolumesListAdminTestJSON-1635913052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:30:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-eeb0cbcd-c204-4c6c-8a88-bf39ba21a501 tempest-VolumesListAdminTestJSON-1635913052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:30:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-eeb0cbcd-c204-4c6c-8a88-bf39ba21a501 tempest-VolumesListAdminTestJSON-1635913052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-eeb0cbcd-c204-4c6c-8a88-bf39ba21a501 tempest-VolumesListAdminTestJSON-1635913052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:15 devstack sudo[87693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:30:15 devstack sudo[87693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:15 devstack sudo[87690]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a12d0ac7-ee70-4f5d-8d34-af6e97cf723b tempest-VolumesListAdminTestJSON-1674097898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-661bd1f5-9287-4f9f-a94d-77141a83e710" returned: 0 in 0.609s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:15 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a12d0ac7-ee70-4f5d-8d34-af6e97cf723b tempest-VolumesListAdminTestJSON-1674097898 None] Lock "cinder-quobyte-661bd1f5-9287-4f9f-a94d-77141a83e710" released by "delete_volume" :: held 1.245s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:15 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-a12d0ac7-ee70-4f5d-8d34-af6e97cf723b tempest-VolumesListAdminTestJSON-1674097898 None] Created reservations ['ecc61b13-cdb7-4686-97e3-77f1859a03c4', '10335b3e-029d-45e9-b988-05a83c649af8', '9e0d7d3e-441e-47d8-ba25-ecc690fa86e7', '93e7a211-a851-4f1e-9b3e-a3b9386d6bc7'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:30:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a12d0ac7-ee70-4f5d-8d34-af6e97cf723b tempest-VolumesListAdminTestJSON-1674097898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a12d0ac7-ee70-4f5d-8d34-af6e97cf723b tempest-VolumesListAdminTestJSON-1674097898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-a12d0ac7-ee70-4f5d-8d34-af6e97cf723b tempest-VolumesListAdminTestJSON-1674097898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:30:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-a12d0ac7-ee70-4f5d-8d34-af6e97cf723b tempest-VolumesListAdminTestJSON-1674097898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:30:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a12d0ac7-ee70-4f5d-8d34-af6e97cf723b tempest-VolumesListAdminTestJSON-1674097898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a12d0ac7-ee70-4f5d-8d34-af6e97cf723b tempest-VolumesListAdminTestJSON-1674097898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:15 devstack sudo[87696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:30:15 devstack sudo[87696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:16 devstack sudo[87693]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-eeb0cbcd-c204-4c6c-8a88-bf39ba21a501 tempest-VolumesListAdminTestJSON-1635913052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.499s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:16 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-eeb0cbcd-c204-4c6c-8a88-bf39ba21a501 tempest-VolumesListAdminTestJSON-1635913052 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:30:16 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-eeb0cbcd-c204-4c6c-8a88-bf39ba21a501 tempest-VolumesListAdminTestJSON-1635913052 None] Deleted volume successfully.
Apr 02 10:30:16 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-eeb0cbcd-c204-4c6c-8a88-bf39ba21a501 tempest-VolumesListAdminTestJSON-1635913052 None] Lock "cinder-a9323625-320d-49a1-9244-82390597147d-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:16 devstack sudo[87696]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a12d0ac7-ee70-4f5d-8d34-af6e97cf723b tempest-VolumesListAdminTestJSON-1674097898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.524s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:16 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-a12d0ac7-ee70-4f5d-8d34-af6e97cf723b tempest-VolumesListAdminTestJSON-1674097898 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:30:16 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-a12d0ac7-ee70-4f5d-8d34-af6e97cf723b tempest-VolumesListAdminTestJSON-1674097898 None] Deleted volume successfully.
Apr 02 10:30:16 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a12d0ac7-ee70-4f5d-8d34-af6e97cf723b tempest-VolumesListAdminTestJSON-1674097898 None] Lock "cinder-661bd1f5-9287-4f9f-a94d-77141a83e710-delete_volume" released by "delete_volume" :: held 1.975s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:16 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a47ec89c-8337-41f1-9dd5-60a905dac49e tempest-VolumesListAdminTestJSON-1674097898 None] Acquiring lock "cinder-d819e1bc-2a2d-494e-af0c-3b2ac13f2613-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:16 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a47ec89c-8337-41f1-9dd5-60a905dac49e tempest-VolumesListAdminTestJSON-1674097898 None] Lock "cinder-d819e1bc-2a2d-494e-af0c-3b2ac13f2613-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:16 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a47ec89c-8337-41f1-9dd5-60a905dac49e tempest-VolumesListAdminTestJSON-1674097898 None] Acquiring lock "cinder-quobyte-d819e1bc-2a2d-494e-af0c-3b2ac13f2613" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:16 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a47ec89c-8337-41f1-9dd5-60a905dac49e tempest-VolumesListAdminTestJSON-1674097898 None] Lock "cinder-quobyte-d819e1bc-2a2d-494e-af0c-3b2ac13f2613" acquired by "delete_volume" :: waited 0.011s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:16 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5382e094-efe9-48a2-8bfa-6054cc6e9bd3]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:30:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a47ec89c-8337-41f1-9dd5-60a905dac49e tempest-VolumesListAdminTestJSON-1674097898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d819e1bc-2a2d-494e-af0c-3b2ac13f2613 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:16 devstack sudo[87700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d819e1bc-2a2d-494e-af0c-3b2ac13f2613
Apr 02 10:30:16 devstack sudo[87700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:17 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-562dea1b-6268-4d3c-91d3-bad00d57894d tempest-CinderUnicodeTest-404038551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:30:17 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-562dea1b-6268-4d3c-91d3-bad00d57894d tempest-CinderUnicodeTest-404038551 None] Flow 'volume_create_manager' (51f1eae8-bcd0-4cfb-9782-60196bbabe73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:30:17 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-562dea1b-6268-4d3c-91d3-bad00d57894d tempest-CinderUnicodeTest-404038551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbbee14c-f656-4d23-8370-75d95801a904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:17 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-562dea1b-6268-4d3c-91d3-bad00d57894d tempest-CinderUnicodeTest-404038551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbbee14c-f656-4d23-8370-75d95801a904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72138bfd-c614-4829-9766-bb6118396718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79a1ad98195545479165bf4007c098f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:17Z,use_quota=True,user_id='6141bdb5158f4b649262d0facff733c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:17 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-562dea1b-6268-4d3c-91d3-bad00d57894d tempest-CinderUnicodeTest-404038551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f803454a-663c-491b-b6b6-4231f363ec29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:17 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-562dea1b-6268-4d3c-91d3-bad00d57894d tempest-CinderUnicodeTest-404038551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f803454a-663c-491b-b6b6-4231f363ec29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:17 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-562dea1b-6268-4d3c-91d3-bad00d57894d tempest-CinderUnicodeTest-404038551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65cef3c2-2438-4619-be58-eeb1ffe7c7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:17 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-562dea1b-6268-4d3c-91d3-bad00d57894d tempest-CinderUnicodeTest-404038551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65cef3c2-2438-4619-be58-eeb1ffe7c7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72138bfd-c614-4829-9766-bb6118396718', 'volume_name': 'volume-72138bfd-c614-4829-9766-bb6118396718', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:17 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-562dea1b-6268-4d3c-91d3-bad00d57894d tempest-CinderUnicodeTest-404038551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc11c183-3cb2-412c-9ca5-0eec0e7e1468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:17 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-562dea1b-6268-4d3c-91d3-bad00d57894d tempest-CinderUnicodeTest-404038551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc11c183-3cb2-412c-9ca5-0eec0e7e1468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:17 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-562dea1b-6268-4d3c-91d3-bad00d57894d tempest-CinderUnicodeTest-404038551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d016744-af9d-47dd-8457-bce750e1b188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:17 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-562dea1b-6268-4d3c-91d3-bad00d57894d tempest-CinderUnicodeTest-404038551 None] Volume 72138bfd-c614-4829-9766-bb6118396718: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72138bfd-c614-4829-9766-bb6118396718', 'volume_size': 1}
Apr 02 10:30:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-562dea1b-6268-4d3c-91d3-bad00d57894d tempest-CinderUnicodeTest-404038551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-562dea1b-6268-4d3c-91d3-bad00d57894d tempest-CinderUnicodeTest-404038551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:17 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-562dea1b-6268-4d3c-91d3-bad00d57894d tempest-CinderUnicodeTest-404038551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72138bfd-c614-4829-9766-bb6118396718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79a1ad98195545479165bf4007c098f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:17Z,use_quota=True,user_id='6141bdb5158f4b649262d0facff733c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:30:17 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-562dea1b-6268-4d3c-91d3-bad00d57894d tempest-CinderUnicodeTest-404038551 None] Creating volume 72138bfd-c614-4829-9766-bb6118396718 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:30:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-562dea1b-6268-4d3c-91d3-bad00d57894d tempest-CinderUnicodeTest-404038551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-562dea1b-6268-4d3c-91d3-bad00d57894d tempest-CinderUnicodeTest-404038551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:17 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-562dea1b-6268-4d3c-91d3-bad00d57894d tempest-CinderUnicodeTest-404038551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:30:17 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-562dea1b-6268-4d3c-91d3-bad00d57894d tempest-CinderUnicodeTest-404038551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:30:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-562dea1b-6268-4d3c-91d3-bad00d57894d tempest-CinderUnicodeTest-404038551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:17 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-562dea1b-6268-4d3c-91d3-bad00d57894d tempest-CinderUnicodeTest-404038551 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:30:17 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-562dea1b-6268-4d3c-91d3-bad00d57894d tempest-CinderUnicodeTest-404038551 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:30:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-562dea1b-6268-4d3c-91d3-bad00d57894d tempest-CinderUnicodeTest-404038551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-72138bfd-c614-4829-9766-bb6118396718 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:17 devstack sudo[87705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-72138bfd-c614-4829-9766-bb6118396718 1073741824
Apr 02 10:30:17 devstack sudo[87705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:17 devstack sudo[87700]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a47ec89c-8337-41f1-9dd5-60a905dac49e tempest-VolumesListAdminTestJSON-1674097898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d819e1bc-2a2d-494e-af0c-3b2ac13f2613" returned: 0 in 0.568s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a47ec89c-8337-41f1-9dd5-60a905dac49e tempest-VolumesListAdminTestJSON-1674097898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d819e1bc-2a2d-494e-af0c-3b2ac13f2613 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:17 devstack sudo[87707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d819e1bc-2a2d-494e-af0c-3b2ac13f2613
Apr 02 10:30:17 devstack sudo[87707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:17 devstack sudo[87705]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-562dea1b-6268-4d3c-91d3-bad00d57894d tempest-CinderUnicodeTest-404038551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-72138bfd-c614-4829-9766-bb6118396718 1073741824" returned: 0 in 0.594s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:17 devstack sudo[87707]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a47ec89c-8337-41f1-9dd5-60a905dac49e tempest-VolumesListAdminTestJSON-1674097898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d819e1bc-2a2d-494e-af0c-3b2ac13f2613" returned: 0 in 0.523s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:17 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a47ec89c-8337-41f1-9dd5-60a905dac49e tempest-VolumesListAdminTestJSON-1674097898 None] Lock "cinder-quobyte-d819e1bc-2a2d-494e-af0c-3b2ac13f2613" released by "delete_volume" :: held 1.115s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-562dea1b-6268-4d3c-91d3-bad00d57894d tempest-CinderUnicodeTest-404038551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-72138bfd-c614-4829-9766-bb6118396718 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:17 devstack sudo[87713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-72138bfd-c614-4829-9766-bb6118396718
Apr 02 10:30:17 devstack sudo[87713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:17 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-a47ec89c-8337-41f1-9dd5-60a905dac49e tempest-VolumesListAdminTestJSON-1674097898 None] Created reservations ['8aadeabd-cf7b-4ecc-9e1a-be3de0035953', 'f88ac387-3518-4d1d-ae01-55c8d44a521f', '32737b0d-7489-4a2a-b9b6-48f39680d8f6', 'db86a6e0-0963-4e63-8e61-bf23033dd0b3'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:30:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a47ec89c-8337-41f1-9dd5-60a905dac49e tempest-VolumesListAdminTestJSON-1674097898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a47ec89c-8337-41f1-9dd5-60a905dac49e tempest-VolumesListAdminTestJSON-1674097898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:17 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-a47ec89c-8337-41f1-9dd5-60a905dac49e tempest-VolumesListAdminTestJSON-1674097898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:30:17 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-a47ec89c-8337-41f1-9dd5-60a905dac49e tempest-VolumesListAdminTestJSON-1674097898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:30:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a47ec89c-8337-41f1-9dd5-60a905dac49e tempest-VolumesListAdminTestJSON-1674097898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a47ec89c-8337-41f1-9dd5-60a905dac49e tempest-VolumesListAdminTestJSON-1674097898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:17 devstack sudo[87715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:30:17 devstack sudo[87715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:18 devstack sudo[87713]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-562dea1b-6268-4d3c-91d3-bad00d57894d tempest-CinderUnicodeTest-404038551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-72138bfd-c614-4829-9766-bb6118396718" returned: 0 in 0.523s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:18 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-562dea1b-6268-4d3c-91d3-bad00d57894d tempest-CinderUnicodeTest-404038551 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:30:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-562dea1b-6268-4d3c-91d3-bad00d57894d tempest-CinderUnicodeTest-404038551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-562dea1b-6268-4d3c-91d3-bad00d57894d tempest-CinderUnicodeTest-404038551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d016744-af9d-47dd-8457-bce750e1b188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72138bfd-c614-4829-9766-bb6118396718', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-562dea1b-6268-4d3c-91d3-bad00d57894d tempest-CinderUnicodeTest-404038551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07182737-5643-477d-b2c6-8f385942d488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:18 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-562dea1b-6268-4d3c-91d3-bad00d57894d tempest-CinderUnicodeTest-404038551 None] Volume volume-72138bfd-c614-4829-9766-bb6118396718 (72138bfd-c614-4829-9766-bb6118396718): created successfully
Apr 02 10:30:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-562dea1b-6268-4d3c-91d3-bad00d57894d tempest-CinderUnicodeTest-404038551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07182737-5643-477d-b2c6-8f385942d488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-562dea1b-6268-4d3c-91d3-bad00d57894d tempest-CinderUnicodeTest-404038551 None] Flow 'volume_create_manager' (51f1eae8-bcd0-4cfb-9782-60196bbabe73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:30:18 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-562dea1b-6268-4d3c-91d3-bad00d57894d tempest-CinderUnicodeTest-404038551 None] Created volume successfully.
Apr 02 10:30:18 devstack sudo[87715]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a47ec89c-8337-41f1-9dd5-60a905dac49e tempest-VolumesListAdminTestJSON-1674097898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.478s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:18 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-a47ec89c-8337-41f1-9dd5-60a905dac49e tempest-VolumesListAdminTestJSON-1674097898 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:30:18 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-a47ec89c-8337-41f1-9dd5-60a905dac49e tempest-VolumesListAdminTestJSON-1674097898 None] Deleted volume successfully.
Apr 02 10:30:18 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a47ec89c-8337-41f1-9dd5-60a905dac49e tempest-VolumesListAdminTestJSON-1674097898 None] Lock "cinder-d819e1bc-2a2d-494e-af0c-3b2ac13f2613-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:18 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2ae8efed-68f6-4e80-b81e-1a5ab040a731 tempest-VolumesListAdminTestJSON-1674097898 None] Acquiring lock "cinder-97d42f51-b100-4a41-8380-e04f516769c4-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:18 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2ae8efed-68f6-4e80-b81e-1a5ab040a731 tempest-VolumesListAdminTestJSON-1674097898 None] Lock "cinder-97d42f51-b100-4a41-8380-e04f516769c4-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:18 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2ae8efed-68f6-4e80-b81e-1a5ab040a731 tempest-VolumesListAdminTestJSON-1674097898 None] Acquiring lock "cinder-quobyte-97d42f51-b100-4a41-8380-e04f516769c4" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:19 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2ae8efed-68f6-4e80-b81e-1a5ab040a731 tempest-VolumesListAdminTestJSON-1674097898 None] Lock "cinder-quobyte-97d42f51-b100-4a41-8380-e04f516769c4" acquired by "delete_volume" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:19 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed5d6fe-6ed8-4362-8528-4a808a917e69]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:30:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2ae8efed-68f6-4e80-b81e-1a5ab040a731 tempest-VolumesListAdminTestJSON-1674097898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-97d42f51-b100-4a41-8380-e04f516769c4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:19 devstack sudo[87719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-97d42f51-b100-4a41-8380-e04f516769c4
Apr 02 10:30:19 devstack sudo[87719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:19 devstack sudo[87719]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2ae8efed-68f6-4e80-b81e-1a5ab040a731 tempest-VolumesListAdminTestJSON-1674097898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-97d42f51-b100-4a41-8380-e04f516769c4" returned: 0 in 0.549s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2ae8efed-68f6-4e80-b81e-1a5ab040a731 tempest-VolumesListAdminTestJSON-1674097898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-97d42f51-b100-4a41-8380-e04f516769c4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:19 devstack sudo[87724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-97d42f51-b100-4a41-8380-e04f516769c4
Apr 02 10:30:19 devstack sudo[87724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:19 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-739dc70f-1216-4315-9689-76e803957274 tempest-CinderUnicodeTest-404038551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:30:19 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-739dc70f-1216-4315-9689-76e803957274 tempest-CinderUnicodeTest-404038551 None] Flow 'volume_create_manager' (c37e32cb-97b2-4bea-8da3-c89b16cae69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:30:19 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-739dc70f-1216-4315-9689-76e803957274 tempest-CinderUnicodeTest-404038551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf0a01d-ff30-46bc-909d-c238344b8f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:19 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-739dc70f-1216-4315-9689-76e803957274 tempest-CinderUnicodeTest-404038551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf0a01d-ff30-46bc-909d-c238344b8f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:30:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1103663772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d717351-1de4-4521-8057-b118da1439c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79a1ad98195545479165bf4007c098f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:20Z,use_quota=True,user_id='6141bdb5158f4b649262d0facff733c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:19 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-739dc70f-1216-4315-9689-76e803957274 tempest-CinderUnicodeTest-404038551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97ebbce7-cd09-4739-8e4e-57c31609e09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:19 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-739dc70f-1216-4315-9689-76e803957274 tempest-CinderUnicodeTest-404038551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97ebbce7-cd09-4739-8e4e-57c31609e09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:19 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-739dc70f-1216-4315-9689-76e803957274 tempest-CinderUnicodeTest-404038551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1110bc-8c17-427e-bd56-c312c328f110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:19 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-739dc70f-1216-4315-9689-76e803957274 tempest-CinderUnicodeTest-404038551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1110bc-8c17-427e-bd56-c312c328f110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d717351-1de4-4521-8057-b118da1439c6', 'volume_name': 'volume-3d717351-1de4-4521-8057-b118da1439c6', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:19 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-739dc70f-1216-4315-9689-76e803957274 tempest-CinderUnicodeTest-404038551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d77c78-afc4-446d-92ce-bc206b2670e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:19 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-739dc70f-1216-4315-9689-76e803957274 tempest-CinderUnicodeTest-404038551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d77c78-afc4-446d-92ce-bc206b2670e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:19 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-739dc70f-1216-4315-9689-76e803957274 tempest-CinderUnicodeTest-404038551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a92d8991-52b6-4b8f-881f-fb90f1812bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:19 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-739dc70f-1216-4315-9689-76e803957274 tempest-CinderUnicodeTest-404038551 None] Volume 3d717351-1de4-4521-8057-b118da1439c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d717351-1de4-4521-8057-b118da1439c6', 'volume_size': 1}
Apr 02 10:30:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-739dc70f-1216-4315-9689-76e803957274 tempest-CinderUnicodeTest-404038551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-739dc70f-1216-4315-9689-76e803957274 tempest-CinderUnicodeTest-404038551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:19 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-739dc70f-1216-4315-9689-76e803957274 tempest-CinderUnicodeTest-404038551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:30:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1103663772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d717351-1de4-4521-8057-b118da1439c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79a1ad98195545479165bf4007c098f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:20Z,use_quota=True,user_id='6141bdb5158f4b649262d0facff733c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:30:19 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-739dc70f-1216-4315-9689-76e803957274 tempest-CinderUnicodeTest-404038551 None] Creating volume 3d717351-1de4-4521-8057-b118da1439c6 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:30:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-739dc70f-1216-4315-9689-76e803957274 tempest-CinderUnicodeTest-404038551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-739dc70f-1216-4315-9689-76e803957274 tempest-CinderUnicodeTest-404038551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:19 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-739dc70f-1216-4315-9689-76e803957274 tempest-CinderUnicodeTest-404038551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:30:19 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-739dc70f-1216-4315-9689-76e803957274 tempest-CinderUnicodeTest-404038551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:30:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-739dc70f-1216-4315-9689-76e803957274 tempest-CinderUnicodeTest-404038551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:19 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-739dc70f-1216-4315-9689-76e803957274 tempest-CinderUnicodeTest-404038551 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:30:19 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-739dc70f-1216-4315-9689-76e803957274 tempest-CinderUnicodeTest-404038551 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:30:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-739dc70f-1216-4315-9689-76e803957274 tempest-CinderUnicodeTest-404038551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:19 devstack sudo[87726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6 1073741824
Apr 02 10:30:19 devstack sudo[87726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:19 devstack sudo[87724]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2ae8efed-68f6-4e80-b81e-1a5ab040a731 tempest-VolumesListAdminTestJSON-1674097898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-97d42f51-b100-4a41-8380-e04f516769c4" returned: 0 in 0.427s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:20 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2ae8efed-68f6-4e80-b81e-1a5ab040a731 tempest-VolumesListAdminTestJSON-1674097898 None] Lock "cinder-quobyte-97d42f51-b100-4a41-8380-e04f516769c4" released by "delete_volume" :: held 1.003s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:20 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-2ae8efed-68f6-4e80-b81e-1a5ab040a731 tempest-VolumesListAdminTestJSON-1674097898 None] Created reservations ['6dc41249-1933-4b6e-8a4e-87f212ac8a82', '597c7b3e-10d8-40eb-9191-ee7479d42f27', '43a6f4ce-2b96-44ed-9793-210c3da59597', '1d9b54d2-5385-4122-9fd6-8dc5e3b9e6d0'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:30:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-2ae8efed-68f6-4e80-b81e-1a5ab040a731 tempest-VolumesListAdminTestJSON-1674097898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-2ae8efed-68f6-4e80-b81e-1a5ab040a731 tempest-VolumesListAdminTestJSON-1674097898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:20 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-2ae8efed-68f6-4e80-b81e-1a5ab040a731 tempest-VolumesListAdminTestJSON-1674097898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:30:20 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-2ae8efed-68f6-4e80-b81e-1a5ab040a731 tempest-VolumesListAdminTestJSON-1674097898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:30:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-2ae8efed-68f6-4e80-b81e-1a5ab040a731 tempest-VolumesListAdminTestJSON-1674097898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2ae8efed-68f6-4e80-b81e-1a5ab040a731 tempest-VolumesListAdminTestJSON-1674097898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:20 devstack sudo[87732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:30:20 devstack sudo[87732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:20 devstack sudo[87726]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-739dc70f-1216-4315-9689-76e803957274 tempest-CinderUnicodeTest-404038551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6 1073741824" returned: 0 in 0.552s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-739dc70f-1216-4315-9689-76e803957274 tempest-CinderUnicodeTest-404038551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:20 devstack sudo[87734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6
Apr 02 10:30:20 devstack sudo[87734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:20 devstack sudo[87732]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2ae8efed-68f6-4e80-b81e-1a5ab040a731 tempest-VolumesListAdminTestJSON-1674097898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.434s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:20 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-2ae8efed-68f6-4e80-b81e-1a5ab040a731 tempest-VolumesListAdminTestJSON-1674097898 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:30:20 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-2ae8efed-68f6-4e80-b81e-1a5ab040a731 tempest-VolumesListAdminTestJSON-1674097898 None] Deleted volume successfully.
Apr 02 10:30:20 devstack sudo[87734]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-739dc70f-1216-4315-9689-76e803957274 tempest-CinderUnicodeTest-404038551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6" returned: 0 in 0.429s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:20 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-739dc70f-1216-4315-9689-76e803957274 tempest-CinderUnicodeTest-404038551 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:30:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-739dc70f-1216-4315-9689-76e803957274 tempest-CinderUnicodeTest-404038551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:20 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2ae8efed-68f6-4e80-b81e-1a5ab040a731 tempest-VolumesListAdminTestJSON-1674097898 None] Lock "cinder-97d42f51-b100-4a41-8380-e04f516769c4-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:20 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-739dc70f-1216-4315-9689-76e803957274 tempest-CinderUnicodeTest-404038551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a92d8991-52b6-4b8f-881f-fb90f1812bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d717351-1de4-4521-8057-b118da1439c6', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:20 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-739dc70f-1216-4315-9689-76e803957274 tempest-CinderUnicodeTest-404038551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f078c81-5f5b-4cee-9c8a-ad6009fc7a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:20 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-739dc70f-1216-4315-9689-76e803957274 tempest-CinderUnicodeTest-404038551 None] Volume volume-3d717351-1de4-4521-8057-b118da1439c6 (3d717351-1de4-4521-8057-b118da1439c6): created successfully
Apr 02 10:30:20 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-739dc70f-1216-4315-9689-76e803957274 tempest-CinderUnicodeTest-404038551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f078c81-5f5b-4cee-9c8a-ad6009fc7a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:20 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-739dc70f-1216-4315-9689-76e803957274 tempest-CinderUnicodeTest-404038551 None] Flow 'volume_create_manager' (c37e32cb-97b2-4bea-8da3-c89b16cae69b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:30:20 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-739dc70f-1216-4315-9689-76e803957274 tempest-CinderUnicodeTest-404038551 None] Created volume successfully.
Apr 02 10:30:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bbe4befa-c18c-4f2e-85a0-1a35c3ef5477 tempest-CinderUnicodeTest-404038551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bbe4befa-c18c-4f2e-85a0-1a35c3ef5477 tempest-CinderUnicodeTest-404038551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:21 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-bbe4befa-c18c-4f2e-85a0-1a35c3ef5477 tempest-CinderUnicodeTest-404038551 None] Creating offline snapshot d037e5f1-1411-4459-b48f-4b0fff8e0052 of volume 3d717351-1de4-4521-8057-b118da1439c6 {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:30:21 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d211285-6956-400a-a688-cacecf736883]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:30:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bbe4befa-c18c-4f2e-85a0-1a35c3ef5477 tempest-CinderUnicodeTest-404038551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:22 devstack sudo[87740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6
Apr 02 10:30:22 devstack sudo[87740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:22 devstack sudo[87740]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bbe4befa-c18c-4f2e-85a0-1a35c3ef5477 tempest-CinderUnicodeTest-404038551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6" returned: 0 in 0.539s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bbe4befa-c18c-4f2e-85a0-1a35c3ef5477 tempest-CinderUnicodeTest-404038551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6.d037e5f1-1411-4459-b48f-4b0fff8e0052 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:22 devstack sudo[87745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6.d037e5f1-1411-4459-b48f-4b0fff8e0052 1G
Apr 02 10:30:22 devstack sudo[87745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:23 devstack sudo[87745]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bbe4befa-c18c-4f2e-85a0-1a35c3ef5477 tempest-CinderUnicodeTest-404038551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6.d037e5f1-1411-4459-b48f-4b0fff8e0052 1G" returned: 0 in 0.603s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bbe4befa-c18c-4f2e-85a0-1a35c3ef5477 tempest-CinderUnicodeTest-404038551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d717351-1de4-4521-8057-b118da1439c6 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6.d037e5f1-1411-4459-b48f-4b0fff8e0052 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:23 devstack sudo[87751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d717351-1de4-4521-8057-b118da1439c6 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6.d037e5f1-1411-4459-b48f-4b0fff8e0052
Apr 02 10:30:23 devstack sudo[87751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:23 devstack sudo[87751]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bbe4befa-c18c-4f2e-85a0-1a35c3ef5477 tempest-CinderUnicodeTest-404038551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d717351-1de4-4521-8057-b118da1439c6 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6.d037e5f1-1411-4459-b48f-4b0fff8e0052" returned: 0 in 0.540s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:23 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-bbe4befa-c18c-4f2e-85a0-1a35c3ef5477 tempest-CinderUnicodeTest-404038551 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6.d037e5f1-1411-4459-b48f-4b0fff8e0052 is being set with open permissions: ugo+rw
Apr 02 10:30:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bbe4befa-c18c-4f2e-85a0-1a35c3ef5477 tempest-CinderUnicodeTest-404038551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6.d037e5f1-1411-4459-b48f-4b0fff8e0052 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:23 devstack sudo[87756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6.d037e5f1-1411-4459-b48f-4b0fff8e0052
Apr 02 10:30:23 devstack sudo[87756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:24 devstack sudo[87756]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bbe4befa-c18c-4f2e-85a0-1a35c3ef5477 tempest-CinderUnicodeTest-404038551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6.d037e5f1-1411-4459-b48f-4b0fff8e0052" returned: 0 in 0.487s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bbe4befa-c18c-4f2e-85a0-1a35c3ef5477 tempest-CinderUnicodeTest-404038551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:24 devstack sudo[87759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6.info
Apr 02 10:30:24 devstack sudo[87759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:24 devstack sudo[87759]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bbe4befa-c18c-4f2e-85a0-1a35c3ef5477 tempest-CinderUnicodeTest-404038551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6.info" returned: 0 in 0.454s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:24 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-bbe4befa-c18c-4f2e-85a0-1a35c3ef5477 tempest-CinderUnicodeTest-404038551 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6.info is being set with open permissions: ugo+rw
Apr 02 10:30:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bbe4befa-c18c-4f2e-85a0-1a35c3ef5477 tempest-CinderUnicodeTest-404038551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:24 devstack sudo[87762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6.info
Apr 02 10:30:24 devstack sudo[87762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:24 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-88f8e665-a588-4595-af42-5a845e1f65c5 tempest-AbsoluteLimitsTests-109100162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:30:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-88f8e665-a588-4595-af42-5a845e1f65c5 tempest-AbsoluteLimitsTests-109100162 None] Flow 'volume_create_manager' (1ab2bed9-044f-46c0-92b3-ef6c46d013c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:30:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-88f8e665-a588-4595-af42-5a845e1f65c5 tempest-AbsoluteLimitsTests-109100162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd6955e4-2612-4afa-b7ea-25afd779e2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-88f8e665-a588-4595-af42-5a845e1f65c5 tempest-AbsoluteLimitsTests-109100162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd6955e4-2612-4afa-b7ea-25afd779e2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-770694784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d4d329c-2842-430e-bee4-7b9cb7c18533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cbbece585494595b97b6a01d7b2555a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:25Z,use_quota=True,user_id='6978c966829f4784bb5ff8c5f5db5cf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-88f8e665-a588-4595-af42-5a845e1f65c5 tempest-AbsoluteLimitsTests-109100162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdcd714e-f00b-4e38-8d64-c6bc5fd11e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-88f8e665-a588-4595-af42-5a845e1f65c5 tempest-AbsoluteLimitsTests-109100162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdcd714e-f00b-4e38-8d64-c6bc5fd11e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-88f8e665-a588-4595-af42-5a845e1f65c5 tempest-AbsoluteLimitsTests-109100162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f005aa8-5e05-48b2-bd20-6f103790d5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-88f8e665-a588-4595-af42-5a845e1f65c5 tempest-AbsoluteLimitsTests-109100162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f005aa8-5e05-48b2-bd20-6f103790d5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d4d329c-2842-430e-bee4-7b9cb7c18533', 'volume_name': 'volume-8d4d329c-2842-430e-bee4-7b9cb7c18533', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-88f8e665-a588-4595-af42-5a845e1f65c5 tempest-AbsoluteLimitsTests-109100162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88470f4a-01e2-409c-b38d-6676412a5bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-88f8e665-a588-4595-af42-5a845e1f65c5 tempest-AbsoluteLimitsTests-109100162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88470f4a-01e2-409c-b38d-6676412a5bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-88f8e665-a588-4595-af42-5a845e1f65c5 tempest-AbsoluteLimitsTests-109100162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f297f214-97a4-4bc6-a288-4e35364e8b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:25 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-88f8e665-a588-4595-af42-5a845e1f65c5 tempest-AbsoluteLimitsTests-109100162 None] Volume 8d4d329c-2842-430e-bee4-7b9cb7c18533: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d4d329c-2842-430e-bee4-7b9cb7c18533', 'volume_size': 1}
Apr 02 10:30:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-88f8e665-a588-4595-af42-5a845e1f65c5 tempest-AbsoluteLimitsTests-109100162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:25 devstack sudo[87762]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bbe4befa-c18c-4f2e-85a0-1a35c3ef5477 tempest-CinderUnicodeTest-404038551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6.info" returned: 0 in 0.525s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bbe4befa-c18c-4f2e-85a0-1a35c3ef5477 tempest-CinderUnicodeTest-404038551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.240s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-88f8e665-a588-4595-af42-5a845e1f65c5 tempest-AbsoluteLimitsTests-109100162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.108s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:25 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-88f8e665-a588-4595-af42-5a845e1f65c5 tempest-AbsoluteLimitsTests-109100162 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-770694784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d4d329c-2842-430e-bee4-7b9cb7c18533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cbbece585494595b97b6a01d7b2555a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:25Z,use_quota=True,user_id='6978c966829f4784bb5ff8c5f5db5cf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:30:25 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-88f8e665-a588-4595-af42-5a845e1f65c5 tempest-AbsoluteLimitsTests-109100162 None] Creating volume 8d4d329c-2842-430e-bee4-7b9cb7c18533 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:30:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-88f8e665-a588-4595-af42-5a845e1f65c5 tempest-AbsoluteLimitsTests-109100162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-88f8e665-a588-4595-af42-5a845e1f65c5 tempest-AbsoluteLimitsTests-109100162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:25 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-88f8e665-a588-4595-af42-5a845e1f65c5 tempest-AbsoluteLimitsTests-109100162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:30:25 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-88f8e665-a588-4595-af42-5a845e1f65c5 tempest-AbsoluteLimitsTests-109100162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:30:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-88f8e665-a588-4595-af42-5a845e1f65c5 tempest-AbsoluteLimitsTests-109100162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:25 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-88f8e665-a588-4595-af42-5a845e1f65c5 tempest-AbsoluteLimitsTests-109100162 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:30:25 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-88f8e665-a588-4595-af42-5a845e1f65c5 tempest-AbsoluteLimitsTests-109100162 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:30:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-88f8e665-a588-4595-af42-5a845e1f65c5 tempest-AbsoluteLimitsTests-109100162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8d4d329c-2842-430e-bee4-7b9cb7c18533 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:25 devstack sudo[87765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8d4d329c-2842-430e-bee4-7b9cb7c18533 1073741824
Apr 02 10:30:25 devstack sudo[87765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:25 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-bbe4befa-c18c-4f2e-85a0-1a35c3ef5477 tempest-CinderUnicodeTest-404038551 None] Create snapshot completed successfully
Apr 02 10:30:25 devstack sudo[87765]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-88f8e665-a588-4595-af42-5a845e1f65c5 tempest-AbsoluteLimitsTests-109100162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8d4d329c-2842-430e-bee4-7b9cb7c18533 1073741824" returned: 0 in 0.680s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-88f8e665-a588-4595-af42-5a845e1f65c5 tempest-AbsoluteLimitsTests-109100162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8d4d329c-2842-430e-bee4-7b9cb7c18533 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:25 devstack sudo[87770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8d4d329c-2842-430e-bee4-7b9cb7c18533
Apr 02 10:30:25 devstack sudo[87770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:26 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f0986bcf-e19d-444d-a16f-e84293daa7b1 tempest-CinderUnicodeTest-404038551 None] Acquiring lock "cinder-d037e5f1-1411-4459-b48f-4b0fff8e0052-delete_snapshot" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:26 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f0986bcf-e19d-444d-a16f-e84293daa7b1 tempest-CinderUnicodeTest-404038551 None] Lock "cinder-d037e5f1-1411-4459-b48f-4b0fff8e0052-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:26 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f0986bcf-e19d-444d-a16f-e84293daa7b1 tempest-CinderUnicodeTest-404038551 None] Acquiring lock "cinder-quobyte-3d717351-1de4-4521-8057-b118da1439c6" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:26 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f0986bcf-e19d-444d-a16f-e84293daa7b1 tempest-CinderUnicodeTest-404038551 None] Lock "cinder-quobyte-3d717351-1de4-4521-8057-b118da1439c6" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:26 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f0986bcf-e19d-444d-a16f-e84293daa7b1 tempest-CinderUnicodeTest-404038551 None] Acquiring lock "cinder-quobyte-d037e5f1-1411-4459-b48f-4b0fff8e0052" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:26 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f0986bcf-e19d-444d-a16f-e84293daa7b1 tempest-CinderUnicodeTest-404038551 None] Lock "cinder-quobyte-d037e5f1-1411-4459-b48f-4b0fff8e0052" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:26 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-f0986bcf-e19d-444d-a16f-e84293daa7b1 tempest-CinderUnicodeTest-404038551 None] Deleting offline snapshot d037e5f1-1411-4459-b48f-4b0fff8e0052 of volume 3d717351-1de4-4521-8057-b118da1439c6 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:30:26 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-f0986bcf-e19d-444d-a16f-e84293daa7b1 tempest-CinderUnicodeTest-404038551 None] snapshot_file for this snap is: volume-3d717351-1de4-4521-8057-b118da1439c6.d037e5f1-1411-4459-b48f-4b0fff8e0052 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:30:26 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc27893-9e3b-4885-9875-60f34b564215]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:30:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f0986bcf-e19d-444d-a16f-e84293daa7b1 tempest-CinderUnicodeTest-404038551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6.d037e5f1-1411-4459-b48f-4b0fff8e0052 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:26 devstack sudo[87772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6.d037e5f1-1411-4459-b48f-4b0fff8e0052
Apr 02 10:30:26 devstack sudo[87772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:26 devstack sudo[87770]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-88f8e665-a588-4595-af42-5a845e1f65c5 tempest-AbsoluteLimitsTests-109100162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8d4d329c-2842-430e-bee4-7b9cb7c18533" returned: 0 in 0.448s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:26 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-88f8e665-a588-4595-af42-5a845e1f65c5 tempest-AbsoluteLimitsTests-109100162 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:30:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-88f8e665-a588-4595-af42-5a845e1f65c5 tempest-AbsoluteLimitsTests-109100162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:26 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-88f8e665-a588-4595-af42-5a845e1f65c5 tempest-AbsoluteLimitsTests-109100162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f297f214-97a4-4bc6-a288-4e35364e8b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d4d329c-2842-430e-bee4-7b9cb7c18533', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:26 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-88f8e665-a588-4595-af42-5a845e1f65c5 tempest-AbsoluteLimitsTests-109100162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e5c4f9-0d89-4abc-8fe8-8e93301de1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:26 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-88f8e665-a588-4595-af42-5a845e1f65c5 tempest-AbsoluteLimitsTests-109100162 None] Volume volume-8d4d329c-2842-430e-bee4-7b9cb7c18533 (8d4d329c-2842-430e-bee4-7b9cb7c18533): created successfully
Apr 02 10:30:26 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-88f8e665-a588-4595-af42-5a845e1f65c5 tempest-AbsoluteLimitsTests-109100162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e5c4f9-0d89-4abc-8fe8-8e93301de1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:26 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-88f8e665-a588-4595-af42-5a845e1f65c5 tempest-AbsoluteLimitsTests-109100162 None] Flow 'volume_create_manager' (1ab2bed9-044f-46c0-92b3-ef6c46d013c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:30:26 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-88f8e665-a588-4595-af42-5a845e1f65c5 tempest-AbsoluteLimitsTests-109100162 None] Created volume successfully.
Apr 02 10:30:26 devstack sudo[87772]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f0986bcf-e19d-444d-a16f-e84293daa7b1 tempest-CinderUnicodeTest-404038551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6.d037e5f1-1411-4459-b48f-4b0fff8e0052" returned: 0 in 0.544s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:26 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-f0986bcf-e19d-444d-a16f-e84293daa7b1 tempest-CinderUnicodeTest-404038551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d717351-1de4-4521-8057-b118da1439c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:30:26 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e124717-514a-46be-8578-b6656cced31d]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:30:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f0986bcf-e19d-444d-a16f-e84293daa7b1 tempest-CinderUnicodeTest-404038551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:26 devstack sudo[87778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6
Apr 02 10:30:26 devstack sudo[87778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:27 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-be33a79b-21d8-4422-9580-d9cde939e118 tempest-AbsoluteLimitsTests-109100162 None] Acquiring lock "cinder-8d4d329c-2842-430e-bee4-7b9cb7c18533-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:27 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-be33a79b-21d8-4422-9580-d9cde939e118 tempest-AbsoluteLimitsTests-109100162 None] Lock "cinder-8d4d329c-2842-430e-bee4-7b9cb7c18533-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:27 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-be33a79b-21d8-4422-9580-d9cde939e118 tempest-AbsoluteLimitsTests-109100162 None] Acquiring lock "cinder-quobyte-8d4d329c-2842-430e-bee4-7b9cb7c18533" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:27 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-be33a79b-21d8-4422-9580-d9cde939e118 tempest-AbsoluteLimitsTests-109100162 None] Lock "cinder-quobyte-8d4d329c-2842-430e-bee4-7b9cb7c18533" acquired by "delete_volume" :: waited 0.020s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:27 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[18077d01-f52b-4060-93db-1d5f1e620743]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:30:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-be33a79b-21d8-4422-9580-d9cde939e118 tempest-AbsoluteLimitsTests-109100162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8d4d329c-2842-430e-bee4-7b9cb7c18533 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:27 devstack sudo[87778]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f0986bcf-e19d-444d-a16f-e84293daa7b1 tempest-CinderUnicodeTest-404038551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6" returned: 0 in 0.567s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f0986bcf-e19d-444d-a16f-e84293daa7b1 tempest-CinderUnicodeTest-404038551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6.d037e5f1-1411-4459-b48f-4b0fff8e0052 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:27 devstack sudo[87783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8d4d329c-2842-430e-bee4-7b9cb7c18533
Apr 02 10:30:27 devstack sudo[87783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:27 devstack sudo[87784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6.d037e5f1-1411-4459-b48f-4b0fff8e0052
Apr 02 10:30:27 devstack sudo[87784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:27 devstack sudo[87783]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-be33a79b-21d8-4422-9580-d9cde939e118 tempest-AbsoluteLimitsTests-109100162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8d4d329c-2842-430e-bee4-7b9cb7c18533" returned: 0 in 0.520s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-be33a79b-21d8-4422-9580-d9cde939e118 tempest-AbsoluteLimitsTests-109100162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8d4d329c-2842-430e-bee4-7b9cb7c18533 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:27 devstack sudo[87793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8d4d329c-2842-430e-bee4-7b9cb7c18533
Apr 02 10:30:27 devstack sudo[87793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:27 devstack sudo[87784]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f0986bcf-e19d-444d-a16f-e84293daa7b1 tempest-CinderUnicodeTest-404038551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6.d037e5f1-1411-4459-b48f-4b0fff8e0052" returned: 0 in 0.518s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f0986bcf-e19d-444d-a16f-e84293daa7b1 tempest-CinderUnicodeTest-404038551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6.d037e5f1-1411-4459-b48f-4b0fff8e0052 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:27 devstack sudo[87795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6.d037e5f1-1411-4459-b48f-4b0fff8e0052
Apr 02 10:30:27 devstack sudo[87795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:28 devstack sudo[87793]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-be33a79b-21d8-4422-9580-d9cde939e118 tempest-AbsoluteLimitsTests-109100162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8d4d329c-2842-430e-bee4-7b9cb7c18533" returned: 0 in 0.466s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:28 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-be33a79b-21d8-4422-9580-d9cde939e118 tempest-AbsoluteLimitsTests-109100162 None] Lock "cinder-quobyte-8d4d329c-2842-430e-bee4-7b9cb7c18533" released by "delete_volume" :: held 1.023s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:28 devstack sudo[87795]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f0986bcf-e19d-444d-a16f-e84293daa7b1 tempest-CinderUnicodeTest-404038551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6.d037e5f1-1411-4459-b48f-4b0fff8e0052" returned: 0 in 0.467s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:28 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-be33a79b-21d8-4422-9580-d9cde939e118 tempest-AbsoluteLimitsTests-109100162 None] Created reservations ['e4da3227-7176-43b4-8d0c-2e464543df51', '89593eb1-4ed2-4f5d-8f27-8baac3aed505', '0f84da7b-b153-4577-9365-2b88bf201cc2', '778133ac-8241-443c-a9f2-b426924b1aad'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:30:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-be33a79b-21d8-4422-9580-d9cde939e118 tempest-AbsoluteLimitsTests-109100162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-be33a79b-21d8-4422-9580-d9cde939e118 tempest-AbsoluteLimitsTests-109100162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:28 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-be33a79b-21d8-4422-9580-d9cde939e118 tempest-AbsoluteLimitsTests-109100162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:30:28 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-be33a79b-21d8-4422-9580-d9cde939e118 tempest-AbsoluteLimitsTests-109100162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:30:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-be33a79b-21d8-4422-9580-d9cde939e118 tempest-AbsoluteLimitsTests-109100162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-be33a79b-21d8-4422-9580-d9cde939e118 tempest-AbsoluteLimitsTests-109100162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:28 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f0986bcf-e19d-444d-a16f-e84293daa7b1 tempest-CinderUnicodeTest-404038551 None] Lock "cinder-quobyte-d037e5f1-1411-4459-b48f-4b0fff8e0052" released by "_delete_snapshot" :: held 2.227s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:28 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f0986bcf-e19d-444d-a16f-e84293daa7b1 tempest-CinderUnicodeTest-404038551 None] Lock "cinder-quobyte-3d717351-1de4-4521-8057-b118da1439c6" released by "delete_snapshot" :: held 2.242s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:28 devstack sudo[87799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:30:28 devstack sudo[87799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:28 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-f0986bcf-e19d-444d-a16f-e84293daa7b1 tempest-CinderUnicodeTest-404038551 None] Created reservations ['ae87fa53-8a09-46d4-a7db-ed4658316a0b', 'c58638ee-45f5-4910-83af-0d35e4617d85', 'c88a4fa2-52d6-4619-adff-6279dad250f6', '55c439df-81db-429d-b3e5-a20dcfb5dde6'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:30:28 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-f0986bcf-e19d-444d-a16f-e84293daa7b1 tempest-CinderUnicodeTest-404038551 None] Delete snapshot completed successfully.
Apr 02 10:30:28 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f0986bcf-e19d-444d-a16f-e84293daa7b1 tempest-CinderUnicodeTest-404038551 None] Lock "cinder-d037e5f1-1411-4459-b48f-4b0fff8e0052-delete_snapshot" released by "delete_snapshot" :: held 2.338s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:28 devstack sudo[87799]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-be33a79b-21d8-4422-9580-d9cde939e118 tempest-AbsoluteLimitsTests-109100162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.457s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:28 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-be33a79b-21d8-4422-9580-d9cde939e118 tempest-AbsoluteLimitsTests-109100162 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:30:28 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-be33a79b-21d8-4422-9580-d9cde939e118 tempest-AbsoluteLimitsTests-109100162 None] Deleted volume successfully.
Apr 02 10:30:28 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-be33a79b-21d8-4422-9580-d9cde939e118 tempest-AbsoluteLimitsTests-109100162 None] Lock "cinder-8d4d329c-2842-430e-bee4-7b9cb7c18533-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:29 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-517100f3-998d-46fa-94ff-cf9108985b7b tempest-CinderUnicodeTest-404038551 None] Acquiring lock "cinder-3d717351-1de4-4521-8057-b118da1439c6-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:29 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-517100f3-998d-46fa-94ff-cf9108985b7b tempest-CinderUnicodeTest-404038551 None] Lock "cinder-3d717351-1de4-4521-8057-b118da1439c6-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:29 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-517100f3-998d-46fa-94ff-cf9108985b7b tempest-CinderUnicodeTest-404038551 None] Acquiring lock "cinder-quobyte-3d717351-1de4-4521-8057-b118da1439c6" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:29 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-517100f3-998d-46fa-94ff-cf9108985b7b tempest-CinderUnicodeTest-404038551 None] Lock "cinder-quobyte-3d717351-1de4-4521-8057-b118da1439c6" acquired by "delete_volume" :: waited 0.014s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:29 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[173d32ca-ede5-49cd-8672-46eb94e4ccbe]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:30:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-517100f3-998d-46fa-94ff-cf9108985b7b tempest-CinderUnicodeTest-404038551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:29 devstack sudo[87804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6
Apr 02 10:30:29 devstack sudo[87804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:29 devstack sudo[87804]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-517100f3-998d-46fa-94ff-cf9108985b7b tempest-CinderUnicodeTest-404038551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6" returned: 0 in 0.562s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-517100f3-998d-46fa-94ff-cf9108985b7b tempest-CinderUnicodeTest-404038551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:29 devstack sudo[87809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6
Apr 02 10:30:29 devstack sudo[87809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:30 devstack sudo[87809]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-517100f3-998d-46fa-94ff-cf9108985b7b tempest-CinderUnicodeTest-404038551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-3d717351-1de4-4521-8057-b118da1439c6" returned: 0 in 0.507s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:30 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-517100f3-998d-46fa-94ff-cf9108985b7b tempest-CinderUnicodeTest-404038551 None] Lock "cinder-quobyte-3d717351-1de4-4521-8057-b118da1439c6" released by "delete_volume" :: held 1.107s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:30 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-517100f3-998d-46fa-94ff-cf9108985b7b tempest-CinderUnicodeTest-404038551 None] Created reservations ['3299f733-47bc-418e-bf2b-55ee1513a600', 'd70e45d6-87cb-41d2-adbe-245c5b257da0', '7cda3e6f-fb07-4e58-891d-3e88cfbba9b8', 'df4a7ea9-83e1-4d6e-8942-1b2fb83159de'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:30:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-517100f3-998d-46fa-94ff-cf9108985b7b tempest-CinderUnicodeTest-404038551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-517100f3-998d-46fa-94ff-cf9108985b7b tempest-CinderUnicodeTest-404038551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:30 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-517100f3-998d-46fa-94ff-cf9108985b7b tempest-CinderUnicodeTest-404038551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:30:30 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-517100f3-998d-46fa-94ff-cf9108985b7b tempest-CinderUnicodeTest-404038551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:30:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-517100f3-998d-46fa-94ff-cf9108985b7b tempest-CinderUnicodeTest-404038551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-517100f3-998d-46fa-94ff-cf9108985b7b tempest-CinderUnicodeTest-404038551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:30 devstack sudo[87812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:30:30 devstack sudo[87812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:31 devstack sudo[87812]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-517100f3-998d-46fa-94ff-cf9108985b7b tempest-CinderUnicodeTest-404038551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.511s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:31 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-517100f3-998d-46fa-94ff-cf9108985b7b tempest-CinderUnicodeTest-404038551 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:30:31 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-517100f3-998d-46fa-94ff-cf9108985b7b tempest-CinderUnicodeTest-404038551 None] Deleted volume successfully.
Apr 02 10:30:31 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-517100f3-998d-46fa-94ff-cf9108985b7b tempest-CinderUnicodeTest-404038551 None] Lock "cinder-3d717351-1de4-4521-8057-b118da1439c6-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:31 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-cb2843c5-9732-4ad9-8f3e-09ef1418901d tempest-CinderUnicodeTest-404038551 None] Acquiring lock "cinder-72138bfd-c614-4829-9766-bb6118396718-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:31 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-cb2843c5-9732-4ad9-8f3e-09ef1418901d tempest-CinderUnicodeTest-404038551 None] Lock "cinder-72138bfd-c614-4829-9766-bb6118396718-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:31 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-cb2843c5-9732-4ad9-8f3e-09ef1418901d tempest-CinderUnicodeTest-404038551 None] Acquiring lock "cinder-quobyte-72138bfd-c614-4829-9766-bb6118396718" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:31 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-cb2843c5-9732-4ad9-8f3e-09ef1418901d tempest-CinderUnicodeTest-404038551 None] Lock "cinder-quobyte-72138bfd-c614-4829-9766-bb6118396718" acquired by "delete_volume" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:31 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfacce9-917d-4d64-b01e-08beb0c3a8dc]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:30:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cb2843c5-9732-4ad9-8f3e-09ef1418901d tempest-CinderUnicodeTest-404038551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-72138bfd-c614-4829-9766-bb6118396718 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:31 devstack sudo[87818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-72138bfd-c614-4829-9766-bb6118396718
Apr 02 10:30:31 devstack sudo[87818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:32 devstack sudo[87818]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cb2843c5-9732-4ad9-8f3e-09ef1418901d tempest-CinderUnicodeTest-404038551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-72138bfd-c614-4829-9766-bb6118396718" returned: 0 in 0.568s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cb2843c5-9732-4ad9-8f3e-09ef1418901d tempest-CinderUnicodeTest-404038551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-72138bfd-c614-4829-9766-bb6118396718 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:32 devstack sudo[87823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-72138bfd-c614-4829-9766-bb6118396718
Apr 02 10:30:32 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:32 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cb2843c5-9732-4ad9-8f3e-09ef1418901d tempest-CinderUnicodeTest-404038551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-72138bfd-c614-4829-9766-bb6118396718" returned: 0 in 0.463s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:32 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-cb2843c5-9732-4ad9-8f3e-09ef1418901d tempest-CinderUnicodeTest-404038551 None] Lock "cinder-quobyte-72138bfd-c614-4829-9766-bb6118396718" released by "delete_volume" :: held 1.061s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:32 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-cb2843c5-9732-4ad9-8f3e-09ef1418901d tempest-CinderUnicodeTest-404038551 None] Created reservations ['2af54770-f383-44a8-8577-61c42dd6a289', 'ebed683f-fe66-4ef6-b341-aa81d9ba8058', '57562c3c-6d49-4f39-a906-d1e1b3eaf1af', 'd57b1ebb-ed85-4bc8-96ff-7180f3d5ff04'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:30:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-cb2843c5-9732-4ad9-8f3e-09ef1418901d tempest-CinderUnicodeTest-404038551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-cb2843c5-9732-4ad9-8f3e-09ef1418901d tempest-CinderUnicodeTest-404038551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:32 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-cb2843c5-9732-4ad9-8f3e-09ef1418901d tempest-CinderUnicodeTest-404038551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:30:32 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-cb2843c5-9732-4ad9-8f3e-09ef1418901d tempest-CinderUnicodeTest-404038551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:30:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-cb2843c5-9732-4ad9-8f3e-09ef1418901d tempest-CinderUnicodeTest-404038551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cb2843c5-9732-4ad9-8f3e-09ef1418901d tempest-CinderUnicodeTest-404038551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:32 devstack sudo[87826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:30:32 devstack sudo[87826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:33 devstack sudo[87826]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cb2843c5-9732-4ad9-8f3e-09ef1418901d tempest-CinderUnicodeTest-404038551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.444s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:33 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-cb2843c5-9732-4ad9-8f3e-09ef1418901d tempest-CinderUnicodeTest-404038551 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:30:33 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-cb2843c5-9732-4ad9-8f3e-09ef1418901d tempest-CinderUnicodeTest-404038551 None] Deleted volume successfully.
Apr 02 10:30:33 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-cb2843c5-9732-4ad9-8f3e-09ef1418901d tempest-CinderUnicodeTest-404038551 None] Lock "cinder-72138bfd-c614-4829-9766-bb6118396718-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:33 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-bef7a9aa-6011-4078-8c9e-d7642acaed25 tempest-VolumesTransfersTest-711725218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:30:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bef7a9aa-6011-4078-8c9e-d7642acaed25 tempest-VolumesTransfersTest-711725218 None] Flow 'volume_create_manager' (3846ab52-f890-4efd-99e8-7626ec0973f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:30:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bef7a9aa-6011-4078-8c9e-d7642acaed25 tempest-VolumesTransfersTest-711725218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c34f92-fa31-4368-b743-d91f43bb31ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bef7a9aa-6011-4078-8c9e-d7642acaed25 tempest-VolumesTransfersTest-711725218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c34f92-fa31-4368-b743-d91f43bb31ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2094351912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=604ddd56-4521-4109-b015-148a77e2fbbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892ae5c5d688419ab6e1ef956a669b9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:33Z,use_quota=True,user_id='c971a18fa5f04662887358ffc0ec4c9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bef7a9aa-6011-4078-8c9e-d7642acaed25 tempest-VolumesTransfersTest-711725218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (546e0e9a-c645-4126-9118-6cc70948b867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bef7a9aa-6011-4078-8c9e-d7642acaed25 tempest-VolumesTransfersTest-711725218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (546e0e9a-c645-4126-9118-6cc70948b867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bef7a9aa-6011-4078-8c9e-d7642acaed25 tempest-VolumesTransfersTest-711725218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9d8f1ba-b70b-41c7-aaf8-ea0dee68e021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bef7a9aa-6011-4078-8c9e-d7642acaed25 tempest-VolumesTransfersTest-711725218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9d8f1ba-b70b-41c7-aaf8-ea0dee68e021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '604ddd56-4521-4109-b015-148a77e2fbbd', 'volume_name': 'volume-604ddd56-4521-4109-b015-148a77e2fbbd', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bef7a9aa-6011-4078-8c9e-d7642acaed25 tempest-VolumesTransfersTest-711725218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14c1cc28-fb33-43d0-98db-b82752c4733a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bef7a9aa-6011-4078-8c9e-d7642acaed25 tempest-VolumesTransfersTest-711725218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14c1cc28-fb33-43d0-98db-b82752c4733a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bef7a9aa-6011-4078-8c9e-d7642acaed25 tempest-VolumesTransfersTest-711725218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5842e4a-08cb-4de3-86a2-d1c948416c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:33 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-bef7a9aa-6011-4078-8c9e-d7642acaed25 tempest-VolumesTransfersTest-711725218 None] Volume 604ddd56-4521-4109-b015-148a77e2fbbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-604ddd56-4521-4109-b015-148a77e2fbbd', 'volume_size': 1}
Apr 02 10:30:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bef7a9aa-6011-4078-8c9e-d7642acaed25 tempest-VolumesTransfersTest-711725218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bef7a9aa-6011-4078-8c9e-d7642acaed25 tempest-VolumesTransfersTest-711725218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:33 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-bef7a9aa-6011-4078-8c9e-d7642acaed25 tempest-VolumesTransfersTest-711725218 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:30:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2094351912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=604ddd56-4521-4109-b015-148a77e2fbbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892ae5c5d688419ab6e1ef956a669b9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:33Z,use_quota=True,user_id='c971a18fa5f04662887358ffc0ec4c9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:30:33 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-bef7a9aa-6011-4078-8c9e-d7642acaed25 tempest-VolumesTransfersTest-711725218 None] Creating volume 604ddd56-4521-4109-b015-148a77e2fbbd {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:30:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bef7a9aa-6011-4078-8c9e-d7642acaed25 tempest-VolumesTransfersTest-711725218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bef7a9aa-6011-4078-8c9e-d7642acaed25 tempest-VolumesTransfersTest-711725218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:33 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-bef7a9aa-6011-4078-8c9e-d7642acaed25 tempest-VolumesTransfersTest-711725218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:30:33 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-bef7a9aa-6011-4078-8c9e-d7642acaed25 tempest-VolumesTransfersTest-711725218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:30:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bef7a9aa-6011-4078-8c9e-d7642acaed25 tempest-VolumesTransfersTest-711725218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:33 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-bef7a9aa-6011-4078-8c9e-d7642acaed25 tempest-VolumesTransfersTest-711725218 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:30:33 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-bef7a9aa-6011-4078-8c9e-d7642acaed25 tempest-VolumesTransfersTest-711725218 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:30:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bef7a9aa-6011-4078-8c9e-d7642acaed25 tempest-VolumesTransfersTest-711725218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-604ddd56-4521-4109-b015-148a77e2fbbd 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:33 devstack sudo[87829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-604ddd56-4521-4109-b015-148a77e2fbbd 1073741824
Apr 02 10:30:33 devstack sudo[87829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:34 devstack sudo[87829]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bef7a9aa-6011-4078-8c9e-d7642acaed25 tempest-VolumesTransfersTest-711725218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-604ddd56-4521-4109-b015-148a77e2fbbd 1073741824" returned: 0 in 0.632s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bef7a9aa-6011-4078-8c9e-d7642acaed25 tempest-VolumesTransfersTest-711725218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-604ddd56-4521-4109-b015-148a77e2fbbd {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:34 devstack sudo[87834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-604ddd56-4521-4109-b015-148a77e2fbbd
Apr 02 10:30:34 devstack sudo[87834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:34 devstack sudo[87834]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bef7a9aa-6011-4078-8c9e-d7642acaed25 tempest-VolumesTransfersTest-711725218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-604ddd56-4521-4109-b015-148a77e2fbbd" returned: 0 in 0.526s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:34 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-bef7a9aa-6011-4078-8c9e-d7642acaed25 tempest-VolumesTransfersTest-711725218 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:30:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bef7a9aa-6011-4078-8c9e-d7642acaed25 tempest-VolumesTransfersTest-711725218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bef7a9aa-6011-4078-8c9e-d7642acaed25 tempest-VolumesTransfersTest-711725218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5842e4a-08cb-4de3-86a2-d1c948416c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-604ddd56-4521-4109-b015-148a77e2fbbd', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bef7a9aa-6011-4078-8c9e-d7642acaed25 tempest-VolumesTransfersTest-711725218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e226f75e-72cb-4f79-b293-f7788b8f2e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:34 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-bef7a9aa-6011-4078-8c9e-d7642acaed25 tempest-VolumesTransfersTest-711725218 None] Volume volume-604ddd56-4521-4109-b015-148a77e2fbbd (604ddd56-4521-4109-b015-148a77e2fbbd): created successfully
Apr 02 10:30:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bef7a9aa-6011-4078-8c9e-d7642acaed25 tempest-VolumesTransfersTest-711725218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e226f75e-72cb-4f79-b293-f7788b8f2e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bef7a9aa-6011-4078-8c9e-d7642acaed25 tempest-VolumesTransfersTest-711725218 None] Flow 'volume_create_manager' (3846ab52-f890-4efd-99e8-7626ec0973f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:30:34 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-bef7a9aa-6011-4078-8c9e-d7642acaed25 tempest-VolumesTransfersTest-711725218 None] Created volume successfully.
Apr 02 10:30:36 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-d450636e-ea8b-406b-b399-f7afb1fd7466 tempest-VolumesMetadataTest-1258641496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:30:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d450636e-ea8b-406b-b399-f7afb1fd7466 tempest-VolumesMetadataTest-1258641496 None] Flow 'volume_create_manager' (d47670ae-c2f9-48a9-9600-3d24a32125f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:30:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d450636e-ea8b-406b-b399-f7afb1fd7466 tempest-VolumesMetadataTest-1258641496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2adabef9-3d05-47f4-a5b2-4771f83f25df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d450636e-ea8b-406b-b399-f7afb1fd7466 tempest-VolumesMetadataTest-1258641496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2adabef9-3d05-47f4-a5b2-4771f83f25df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-314712782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4be6d70-a7c9-4d78-b43e-2e95ed1d55a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='878db66c60b44c508dc1c43f87157478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:36Z,use_quota=True,user_id='368ecf0021c94022bab9a56f62a32175',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d450636e-ea8b-406b-b399-f7afb1fd7466 tempest-VolumesMetadataTest-1258641496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (411cf70e-63e3-4b7a-88a0-5181beaa4a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d450636e-ea8b-406b-b399-f7afb1fd7466 tempest-VolumesMetadataTest-1258641496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (411cf70e-63e3-4b7a-88a0-5181beaa4a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d450636e-ea8b-406b-b399-f7afb1fd7466 tempest-VolumesMetadataTest-1258641496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f960e49-c84e-43be-980c-e66aa6869641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d450636e-ea8b-406b-b399-f7afb1fd7466 tempest-VolumesMetadataTest-1258641496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f960e49-c84e-43be-980c-e66aa6869641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4be6d70-a7c9-4d78-b43e-2e95ed1d55a5', 'volume_name': 'volume-a4be6d70-a7c9-4d78-b43e-2e95ed1d55a5', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d450636e-ea8b-406b-b399-f7afb1fd7466 tempest-VolumesMetadataTest-1258641496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc3195c5-acb0-45fc-960d-aa8bae2c6504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d450636e-ea8b-406b-b399-f7afb1fd7466 tempest-VolumesMetadataTest-1258641496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc3195c5-acb0-45fc-960d-aa8bae2c6504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d450636e-ea8b-406b-b399-f7afb1fd7466 tempest-VolumesMetadataTest-1258641496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feabbf60-f759-49b6-a68d-788c3b58fd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:36 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-d450636e-ea8b-406b-b399-f7afb1fd7466 tempest-VolumesMetadataTest-1258641496 None] Volume a4be6d70-a7c9-4d78-b43e-2e95ed1d55a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4be6d70-a7c9-4d78-b43e-2e95ed1d55a5', 'volume_size': 1}
Apr 02 10:30:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d450636e-ea8b-406b-b399-f7afb1fd7466 tempest-VolumesMetadataTest-1258641496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d450636e-ea8b-406b-b399-f7afb1fd7466 tempest-VolumesMetadataTest-1258641496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:36 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d450636e-ea8b-406b-b399-f7afb1fd7466 tempest-VolumesMetadataTest-1258641496 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-314712782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4be6d70-a7c9-4d78-b43e-2e95ed1d55a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='878db66c60b44c508dc1c43f87157478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:36Z,use_quota=True,user_id='368ecf0021c94022bab9a56f62a32175',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:30:36 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-d450636e-ea8b-406b-b399-f7afb1fd7466 tempest-VolumesMetadataTest-1258641496 None] Creating volume a4be6d70-a7c9-4d78-b43e-2e95ed1d55a5 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:30:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d450636e-ea8b-406b-b399-f7afb1fd7466 tempest-VolumesMetadataTest-1258641496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d450636e-ea8b-406b-b399-f7afb1fd7466 tempest-VolumesMetadataTest-1258641496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:36 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d450636e-ea8b-406b-b399-f7afb1fd7466 tempest-VolumesMetadataTest-1258641496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:30:36 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d450636e-ea8b-406b-b399-f7afb1fd7466 tempest-VolumesMetadataTest-1258641496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:30:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d450636e-ea8b-406b-b399-f7afb1fd7466 tempest-VolumesMetadataTest-1258641496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:36 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d450636e-ea8b-406b-b399-f7afb1fd7466 tempest-VolumesMetadataTest-1258641496 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:30:36 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-d450636e-ea8b-406b-b399-f7afb1fd7466 tempest-VolumesMetadataTest-1258641496 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:30:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d450636e-ea8b-406b-b399-f7afb1fd7466 tempest-VolumesMetadataTest-1258641496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a4be6d70-a7c9-4d78-b43e-2e95ed1d55a5 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:36 devstack sudo[87837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a4be6d70-a7c9-4d78-b43e-2e95ed1d55a5 1073741824
Apr 02 10:30:36 devstack sudo[87837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:36 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-fcf99890-5957-4659-bdb5-a83363d92dee tempest-VolumesTransfersTest-348103290 None] Transfer volume completed successfully.
Apr 02 10:30:36 devstack sudo[87837]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d450636e-ea8b-406b-b399-f7afb1fd7466 tempest-VolumesMetadataTest-1258641496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a4be6d70-a7c9-4d78-b43e-2e95ed1d55a5 1073741824" returned: 0 in 0.504s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d450636e-ea8b-406b-b399-f7afb1fd7466 tempest-VolumesMetadataTest-1258641496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a4be6d70-a7c9-4d78-b43e-2e95ed1d55a5 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:36 devstack sudo[87842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a4be6d70-a7c9-4d78-b43e-2e95ed1d55a5
Apr 02 10:30:36 devstack sudo[87842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:36 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-39da6ca2-eacb-4ebb-98f3-e1f47e6577e4 tempest-VolumesTransfersTest-701133073 None] Acquiring lock "cinder-604ddd56-4521-4109-b015-148a77e2fbbd-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:36 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-39da6ca2-eacb-4ebb-98f3-e1f47e6577e4 tempest-VolumesTransfersTest-701133073 None] Lock "cinder-604ddd56-4521-4109-b015-148a77e2fbbd-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:37 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-39da6ca2-eacb-4ebb-98f3-e1f47e6577e4 tempest-VolumesTransfersTest-701133073 None] Acquiring lock "cinder-quobyte-604ddd56-4521-4109-b015-148a77e2fbbd" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:37 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-39da6ca2-eacb-4ebb-98f3-e1f47e6577e4 tempest-VolumesTransfersTest-701133073 None] Lock "cinder-quobyte-604ddd56-4521-4109-b015-148a77e2fbbd" acquired by "delete_volume" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:37 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[16eed4f4-d1da-4c92-9cc5-4d8506fe1107]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:30:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-39da6ca2-eacb-4ebb-98f3-e1f47e6577e4 tempest-VolumesTransfersTest-701133073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-604ddd56-4521-4109-b015-148a77e2fbbd {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:37 devstack sudo[87844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-604ddd56-4521-4109-b015-148a77e2fbbd
Apr 02 10:30:37 devstack sudo[87844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:37 devstack sudo[87842]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d450636e-ea8b-406b-b399-f7afb1fd7466 tempest-VolumesMetadataTest-1258641496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a4be6d70-a7c9-4d78-b43e-2e95ed1d55a5" returned: 0 in 0.453s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:37 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d450636e-ea8b-406b-b399-f7afb1fd7466 tempest-VolumesMetadataTest-1258641496 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:30:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d450636e-ea8b-406b-b399-f7afb1fd7466 tempest-VolumesMetadataTest-1258641496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:37 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d450636e-ea8b-406b-b399-f7afb1fd7466 tempest-VolumesMetadataTest-1258641496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feabbf60-f759-49b6-a68d-788c3b58fd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4be6d70-a7c9-4d78-b43e-2e95ed1d55a5', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:37 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d450636e-ea8b-406b-b399-f7afb1fd7466 tempest-VolumesMetadataTest-1258641496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd591e7-5c0c-4f89-9ae2-39924620856f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:37 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-d450636e-ea8b-406b-b399-f7afb1fd7466 tempest-VolumesMetadataTest-1258641496 None] Volume volume-a4be6d70-a7c9-4d78-b43e-2e95ed1d55a5 (a4be6d70-a7c9-4d78-b43e-2e95ed1d55a5): created successfully
Apr 02 10:30:37 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d450636e-ea8b-406b-b399-f7afb1fd7466 tempest-VolumesMetadataTest-1258641496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd591e7-5c0c-4f89-9ae2-39924620856f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:37 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d450636e-ea8b-406b-b399-f7afb1fd7466 tempest-VolumesMetadataTest-1258641496 None] Flow 'volume_create_manager' (d47670ae-c2f9-48a9-9600-3d24a32125f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:30:37 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-d450636e-ea8b-406b-b399-f7afb1fd7466 tempest-VolumesMetadataTest-1258641496 None] Created volume successfully.
Apr 02 10:30:37 devstack sudo[87844]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-39da6ca2-eacb-4ebb-98f3-e1f47e6577e4 tempest-VolumesTransfersTest-701133073 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-604ddd56-4521-4109-b015-148a77e2fbbd" returned: 0 in 0.506s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-39da6ca2-eacb-4ebb-98f3-e1f47e6577e4 tempest-VolumesTransfersTest-701133073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-604ddd56-4521-4109-b015-148a77e2fbbd {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:37 devstack sudo[87850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-604ddd56-4521-4109-b015-148a77e2fbbd
Apr 02 10:30:37 devstack sudo[87850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:37 devstack sudo[87850]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-39da6ca2-eacb-4ebb-98f3-e1f47e6577e4 tempest-VolumesTransfersTest-701133073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-604ddd56-4521-4109-b015-148a77e2fbbd" returned: 0 in 0.386s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:37 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-39da6ca2-eacb-4ebb-98f3-e1f47e6577e4 tempest-VolumesTransfersTest-701133073 None] Lock "cinder-quobyte-604ddd56-4521-4109-b015-148a77e2fbbd" released by "delete_volume" :: held 0.922s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:37 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-39da6ca2-eacb-4ebb-98f3-e1f47e6577e4 tempest-VolumesTransfersTest-701133073 None] Created reservations ['6f296e09-bdf0-4304-9ec8-91cfcb2036a0', '848ce233-595c-4d20-8bc9-9bf36aa587c3', '50a8509c-2a58-495c-ab64-82df492a010a', '4cfb4bf8-9809-418c-8f39-486beef46a7f'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-39da6ca2-eacb-4ebb-98f3-e1f47e6577e4 tempest-VolumesTransfersTest-701133073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-39da6ca2-eacb-4ebb-98f3-e1f47e6577e4 tempest-VolumesTransfersTest-701133073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-39da6ca2-eacb-4ebb-98f3-e1f47e6577e4 tempest-VolumesTransfersTest-701133073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-39da6ca2-eacb-4ebb-98f3-e1f47e6577e4 tempest-VolumesTransfersTest-701133073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-39da6ca2-eacb-4ebb-98f3-e1f47e6577e4 tempest-VolumesTransfersTest-701133073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-39da6ca2-eacb-4ebb-98f3-e1f47e6577e4 tempest-VolumesTransfersTest-701133073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:38 devstack sudo[87853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:30:38 devstack sudo[87853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-521a79b0-6ef2-473f-8e26-5dd27cf7bf27 tempest-VolumesTransfersTest-711725218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-521a79b0-6ef2-473f-8e26-5dd27cf7bf27 tempest-VolumesTransfersTest-711725218 None] Flow 'volume_create_manager' (69896128-9a21-4d55-900c-efec58575319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-521a79b0-6ef2-473f-8e26-5dd27cf7bf27 tempest-VolumesTransfersTest-711725218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f489a2-2090-4a7a-a6f9-d1710d584b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-521a79b0-6ef2-473f-8e26-5dd27cf7bf27 tempest-VolumesTransfersTest-711725218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f489a2-2090-4a7a-a6f9-d1710d584b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1925395379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b99241f8-d034-49a9-9c4a-4f8af9f6b2df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892ae5c5d688419ab6e1ef956a669b9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:38Z,use_quota=True,user_id='c971a18fa5f04662887358ffc0ec4c9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-521a79b0-6ef2-473f-8e26-5dd27cf7bf27 tempest-VolumesTransfersTest-711725218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (335e2648-8aeb-4f70-b029-4efca16b3c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-521a79b0-6ef2-473f-8e26-5dd27cf7bf27 tempest-VolumesTransfersTest-711725218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (335e2648-8aeb-4f70-b029-4efca16b3c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-521a79b0-6ef2-473f-8e26-5dd27cf7bf27 tempest-VolumesTransfersTest-711725218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afaa4a20-d26d-45be-a468-2b79307021cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-521a79b0-6ef2-473f-8e26-5dd27cf7bf27 tempest-VolumesTransfersTest-711725218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afaa4a20-d26d-45be-a468-2b79307021cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b99241f8-d034-49a9-9c4a-4f8af9f6b2df', 'volume_name': 'volume-b99241f8-d034-49a9-9c4a-4f8af9f6b2df', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-521a79b0-6ef2-473f-8e26-5dd27cf7bf27 tempest-VolumesTransfersTest-711725218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69170b2a-fa3b-4143-8fcc-c5bc2ab9f336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:38 devstack sudo[87853]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-521a79b0-6ef2-473f-8e26-5dd27cf7bf27 tempest-VolumesTransfersTest-711725218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69170b2a-fa3b-4143-8fcc-c5bc2ab9f336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-521a79b0-6ef2-473f-8e26-5dd27cf7bf27 tempest-VolumesTransfersTest-711725218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f7ba4c0-00dd-4ac8-be79-2bf431d873dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:38 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-521a79b0-6ef2-473f-8e26-5dd27cf7bf27 tempest-VolumesTransfersTest-711725218 None] Volume b99241f8-d034-49a9-9c4a-4f8af9f6b2df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b99241f8-d034-49a9-9c4a-4f8af9f6b2df', 'volume_size': 1}
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-521a79b0-6ef2-473f-8e26-5dd27cf7bf27 tempest-VolumesTransfersTest-711725218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-521a79b0-6ef2-473f-8e26-5dd27cf7bf27 tempest-VolumesTransfersTest-711725218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-521a79b0-6ef2-473f-8e26-5dd27cf7bf27 tempest-VolumesTransfersTest-711725218 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1925395379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b99241f8-d034-49a9-9c4a-4f8af9f6b2df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892ae5c5d688419ab6e1ef956a669b9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:38Z,use_quota=True,user_id='c971a18fa5f04662887358ffc0ec4c9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-521a79b0-6ef2-473f-8e26-5dd27cf7bf27 tempest-VolumesTransfersTest-711725218 None] Creating volume b99241f8-d034-49a9-9c4a-4f8af9f6b2df {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-521a79b0-6ef2-473f-8e26-5dd27cf7bf27 tempest-VolumesTransfersTest-711725218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-521a79b0-6ef2-473f-8e26-5dd27cf7bf27 tempest-VolumesTransfersTest-711725218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-521a79b0-6ef2-473f-8e26-5dd27cf7bf27 tempest-VolumesTransfersTest-711725218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-521a79b0-6ef2-473f-8e26-5dd27cf7bf27 tempest-VolumesTransfersTest-711725218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-521a79b0-6ef2-473f-8e26-5dd27cf7bf27 tempest-VolumesTransfersTest-711725218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-521a79b0-6ef2-473f-8e26-5dd27cf7bf27 tempest-VolumesTransfersTest-711725218 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:30:38 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-521a79b0-6ef2-473f-8e26-5dd27cf7bf27 tempest-VolumesTransfersTest-711725218 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-521a79b0-6ef2-473f-8e26-5dd27cf7bf27 tempest-VolumesTransfersTest-711725218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b99241f8-d034-49a9-9c4a-4f8af9f6b2df 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-39da6ca2-eacb-4ebb-98f3-e1f47e6577e4 tempest-VolumesTransfersTest-701133073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.479s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-39da6ca2-eacb-4ebb-98f3-e1f47e6577e4 tempest-VolumesTransfersTest-701133073 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:30:38 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-39da6ca2-eacb-4ebb-98f3-e1f47e6577e4 tempest-VolumesTransfersTest-701133073 None] Deleted volume successfully.
Apr 02 10:30:38 devstack sudo[87856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b99241f8-d034-49a9-9c4a-4f8af9f6b2df 1073741824
Apr 02 10:30:38 devstack sudo[87856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-39da6ca2-eacb-4ebb-98f3-e1f47e6577e4 tempest-VolumesTransfersTest-701133073 None] Lock "cinder-604ddd56-4521-4109-b015-148a77e2fbbd-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1d2f78b0-9ca1-4547-8cf5-b917cfedafc9 tempest-VolumesMetadataTest-1258641496 None] Acquiring lock "cinder-a4be6d70-a7c9-4d78-b43e-2e95ed1d55a5-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1d2f78b0-9ca1-4547-8cf5-b917cfedafc9 tempest-VolumesMetadataTest-1258641496 None] Lock "cinder-a4be6d70-a7c9-4d78-b43e-2e95ed1d55a5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1d2f78b0-9ca1-4547-8cf5-b917cfedafc9 tempest-VolumesMetadataTest-1258641496 None] Acquiring lock "cinder-quobyte-a4be6d70-a7c9-4d78-b43e-2e95ed1d55a5" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1d2f78b0-9ca1-4547-8cf5-b917cfedafc9 tempest-VolumesMetadataTest-1258641496 None] Lock "cinder-quobyte-a4be6d70-a7c9-4d78-b43e-2e95ed1d55a5" acquired by "delete_volume" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e579cd3d-b39a-448b-9218-b07b8133cb1d]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:30:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1d2f78b0-9ca1-4547-8cf5-b917cfedafc9 tempest-VolumesMetadataTest-1258641496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a4be6d70-a7c9-4d78-b43e-2e95ed1d55a5 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:38 devstack sudo[87860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a4be6d70-a7c9-4d78-b43e-2e95ed1d55a5
Apr 02 10:30:38 devstack sudo[87860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:39 devstack sudo[87856]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-521a79b0-6ef2-473f-8e26-5dd27cf7bf27 tempest-VolumesTransfersTest-711725218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b99241f8-d034-49a9-9c4a-4f8af9f6b2df 1073741824" returned: 0 in 0.542s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-521a79b0-6ef2-473f-8e26-5dd27cf7bf27 tempest-VolumesTransfersTest-711725218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b99241f8-d034-49a9-9c4a-4f8af9f6b2df {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:39 devstack sudo[87863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b99241f8-d034-49a9-9c4a-4f8af9f6b2df
Apr 02 10:30:39 devstack sudo[87863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:39 devstack sudo[87860]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1d2f78b0-9ca1-4547-8cf5-b917cfedafc9 tempest-VolumesMetadataTest-1258641496 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a4be6d70-a7c9-4d78-b43e-2e95ed1d55a5" returned: 0 in 0.485s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1d2f78b0-9ca1-4547-8cf5-b917cfedafc9 tempest-VolumesMetadataTest-1258641496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a4be6d70-a7c9-4d78-b43e-2e95ed1d55a5 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:39 devstack sudo[87868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a4be6d70-a7c9-4d78-b43e-2e95ed1d55a5
Apr 02 10:30:39 devstack sudo[87868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:39 devstack sudo[87863]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-521a79b0-6ef2-473f-8e26-5dd27cf7bf27 tempest-VolumesTransfersTest-711725218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b99241f8-d034-49a9-9c4a-4f8af9f6b2df" returned: 0 in 0.418s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:39 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-521a79b0-6ef2-473f-8e26-5dd27cf7bf27 tempest-VolumesTransfersTest-711725218 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:30:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-521a79b0-6ef2-473f-8e26-5dd27cf7bf27 tempest-VolumesTransfersTest-711725218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:39 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-521a79b0-6ef2-473f-8e26-5dd27cf7bf27 tempest-VolumesTransfersTest-711725218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f7ba4c0-00dd-4ac8-be79-2bf431d873dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b99241f8-d034-49a9-9c4a-4f8af9f6b2df', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:39 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-521a79b0-6ef2-473f-8e26-5dd27cf7bf27 tempest-VolumesTransfersTest-711725218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d45e879a-d052-4472-a59f-59045d2dd485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:39 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-521a79b0-6ef2-473f-8e26-5dd27cf7bf27 tempest-VolumesTransfersTest-711725218 None] Volume volume-b99241f8-d034-49a9-9c4a-4f8af9f6b2df (b99241f8-d034-49a9-9c4a-4f8af9f6b2df): created successfully
Apr 02 10:30:39 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-521a79b0-6ef2-473f-8e26-5dd27cf7bf27 tempest-VolumesTransfersTest-711725218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d45e879a-d052-4472-a59f-59045d2dd485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:39 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-521a79b0-6ef2-473f-8e26-5dd27cf7bf27 tempest-VolumesTransfersTest-711725218 None] Flow 'volume_create_manager' (69896128-9a21-4d55-900c-efec58575319) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:30:39 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-521a79b0-6ef2-473f-8e26-5dd27cf7bf27 tempest-VolumesTransfersTest-711725218 None] Created volume successfully.
Apr 02 10:30:39 devstack sudo[87868]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1d2f78b0-9ca1-4547-8cf5-b917cfedafc9 tempest-VolumesMetadataTest-1258641496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a4be6d70-a7c9-4d78-b43e-2e95ed1d55a5" returned: 0 in 0.444s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:39 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1d2f78b0-9ca1-4547-8cf5-b917cfedafc9 tempest-VolumesMetadataTest-1258641496 None] Lock "cinder-quobyte-a4be6d70-a7c9-4d78-b43e-2e95ed1d55a5" released by "delete_volume" :: held 0.960s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:39 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-1d2f78b0-9ca1-4547-8cf5-b917cfedafc9 tempest-VolumesMetadataTest-1258641496 None] Created reservations ['2a158c58-6112-409c-91ff-83946226390e', 'c22a6baa-39ce-44ef-b6f2-ed926d7a8b5c', 'e8f6a247-694c-4812-83ea-8c7dfa058a26', 'e0ecc523-39a7-40a4-8f92-aa2f68472c1f'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:30:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-1d2f78b0-9ca1-4547-8cf5-b917cfedafc9 tempest-VolumesMetadataTest-1258641496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-1d2f78b0-9ca1-4547-8cf5-b917cfedafc9 tempest-VolumesMetadataTest-1258641496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:39 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-1d2f78b0-9ca1-4547-8cf5-b917cfedafc9 tempest-VolumesMetadataTest-1258641496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:30:39 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-1d2f78b0-9ca1-4547-8cf5-b917cfedafc9 tempest-VolumesMetadataTest-1258641496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:30:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-1d2f78b0-9ca1-4547-8cf5-b917cfedafc9 tempest-VolumesMetadataTest-1258641496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1d2f78b0-9ca1-4547-8cf5-b917cfedafc9 tempest-VolumesMetadataTest-1258641496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:39 devstack sudo[87872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:30:39 devstack sudo[87872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:40 devstack sudo[87872]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1d2f78b0-9ca1-4547-8cf5-b917cfedafc9 tempest-VolumesMetadataTest-1258641496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.512s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:40 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-1d2f78b0-9ca1-4547-8cf5-b917cfedafc9 tempest-VolumesMetadataTest-1258641496 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:30:40 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-1d2f78b0-9ca1-4547-8cf5-b917cfedafc9 tempest-VolumesMetadataTest-1258641496 None] Deleted volume successfully.
Apr 02 10:30:40 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1d2f78b0-9ca1-4547-8cf5-b917cfedafc9 tempest-VolumesMetadataTest-1258641496 None] Lock "cinder-a4be6d70-a7c9-4d78-b43e-2e95ed1d55a5-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:40 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2684e384-a96c-4d58-8d30-9164ca164614 tempest-VolumesTransfersTest-701133073 None] Acquiring lock "cinder-b99241f8-d034-49a9-9c4a-4f8af9f6b2df-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:40 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2684e384-a96c-4d58-8d30-9164ca164614 tempest-VolumesTransfersTest-701133073 None] Lock "cinder-b99241f8-d034-49a9-9c4a-4f8af9f6b2df-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:40 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2684e384-a96c-4d58-8d30-9164ca164614 tempest-VolumesTransfersTest-701133073 None] Acquiring lock "cinder-quobyte-b99241f8-d034-49a9-9c4a-4f8af9f6b2df" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:40 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2684e384-a96c-4d58-8d30-9164ca164614 tempest-VolumesTransfersTest-701133073 None] Lock "cinder-quobyte-b99241f8-d034-49a9-9c4a-4f8af9f6b2df" acquired by "delete_volume" :: waited 0.018s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:40 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[19229437-a6f4-4252-84b4-3a05e30607cb]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:30:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2684e384-a96c-4d58-8d30-9164ca164614 tempest-VolumesTransfersTest-701133073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b99241f8-d034-49a9-9c4a-4f8af9f6b2df {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:40 devstack sudo[87881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b99241f8-d034-49a9-9c4a-4f8af9f6b2df
Apr 02 10:30:40 devstack sudo[87881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:41 devstack sudo[87881]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2684e384-a96c-4d58-8d30-9164ca164614 tempest-VolumesTransfersTest-701133073 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b99241f8-d034-49a9-9c4a-4f8af9f6b2df" returned: 0 in 0.560s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2684e384-a96c-4d58-8d30-9164ca164614 tempest-VolumesTransfersTest-701133073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b99241f8-d034-49a9-9c4a-4f8af9f6b2df {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:41 devstack sudo[87887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b99241f8-d034-49a9-9c4a-4f8af9f6b2df
Apr 02 10:30:41 devstack sudo[87887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:41 devstack sudo[87887]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2684e384-a96c-4d58-8d30-9164ca164614 tempest-VolumesTransfersTest-701133073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b99241f8-d034-49a9-9c4a-4f8af9f6b2df" returned: 0 in 0.460s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:41 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2684e384-a96c-4d58-8d30-9164ca164614 tempest-VolumesTransfersTest-701133073 None] Lock "cinder-quobyte-b99241f8-d034-49a9-9c4a-4f8af9f6b2df" released by "delete_volume" :: held 1.050s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:41 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-2684e384-a96c-4d58-8d30-9164ca164614 tempest-VolumesTransfersTest-701133073 None] Created reservations ['25d5e2ac-b8b8-49a0-ae20-669dd48ecf65', '1294ca73-ce4f-42e6-94c1-352e7e0c91c0', 'addf7196-8049-4811-b9ef-dea7836f890d', '841277a3-8b50-45e7-a78f-0ada53328e73'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:30:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-2684e384-a96c-4d58-8d30-9164ca164614 tempest-VolumesTransfersTest-701133073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-2684e384-a96c-4d58-8d30-9164ca164614 tempest-VolumesTransfersTest-701133073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:41 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-2684e384-a96c-4d58-8d30-9164ca164614 tempest-VolumesTransfersTest-701133073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:30:41 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-2684e384-a96c-4d58-8d30-9164ca164614 tempest-VolumesTransfersTest-701133073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:30:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-2684e384-a96c-4d58-8d30-9164ca164614 tempest-VolumesTransfersTest-701133073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2684e384-a96c-4d58-8d30-9164ca164614 tempest-VolumesTransfersTest-701133073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:41 devstack sudo[87890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:30:41 devstack sudo[87890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:42 devstack sudo[87890]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2684e384-a96c-4d58-8d30-9164ca164614 tempest-VolumesTransfersTest-701133073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.430s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:42 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-2684e384-a96c-4d58-8d30-9164ca164614 tempest-VolumesTransfersTest-701133073 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:30:42 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-2684e384-a96c-4d58-8d30-9164ca164614 tempest-VolumesTransfersTest-701133073 None] Deleted volume successfully.
Apr 02 10:30:42 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2684e384-a96c-4d58-8d30-9164ca164614 tempest-VolumesTransfersTest-701133073 None] Lock "cinder-b99241f8-d034-49a9-9c4a-4f8af9f6b2df-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:47 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-293adc21-c89a-4c41-9db4-51a9e6293f4b tempest-VolumesCloneTest-381177309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:30:47 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-293adc21-c89a-4c41-9db4-51a9e6293f4b tempest-VolumesCloneTest-381177309 None] Flow 'volume_create_manager' (1983f5d7-2ca8-458a-96dd-a5708088636d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:30:47 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-293adc21-c89a-4c41-9db4-51a9e6293f4b tempest-VolumesCloneTest-381177309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0780c08b-0358-481e-9f4a-6def90df37be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:47 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-293adc21-c89a-4c41-9db4-51a9e6293f4b tempest-VolumesCloneTest-381177309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0780c08b-0358-481e-9f4a-6def90df37be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1672838224',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=807b4769-14df-4df3-8d61-39945fbe778e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab7692fddf954f8481e56710189e6687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:48Z,use_quota=True,user_id='c9d0509449404edbbaf5f544edb69b4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:47 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-293adc21-c89a-4c41-9db4-51a9e6293f4b tempest-VolumesCloneTest-381177309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa3a4d74-a85c-4149-9533-73f037cef228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:47 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-293adc21-c89a-4c41-9db4-51a9e6293f4b tempest-VolumesCloneTest-381177309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa3a4d74-a85c-4149-9533-73f037cef228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:47 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-293adc21-c89a-4c41-9db4-51a9e6293f4b tempest-VolumesCloneTest-381177309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ab082ad-a747-4202-9b8d-5e602dd63a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:47 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-293adc21-c89a-4c41-9db4-51a9e6293f4b tempest-VolumesCloneTest-381177309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ab082ad-a747-4202-9b8d-5e602dd63a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '807b4769-14df-4df3-8d61-39945fbe778e', 'volume_name': 'volume-807b4769-14df-4df3-8d61-39945fbe778e', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:47 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-293adc21-c89a-4c41-9db4-51a9e6293f4b tempest-VolumesCloneTest-381177309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba88dcf0-7095-40c2-80e7-47e37c18a682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:47 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-293adc21-c89a-4c41-9db4-51a9e6293f4b tempest-VolumesCloneTest-381177309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba88dcf0-7095-40c2-80e7-47e37c18a682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:47 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-293adc21-c89a-4c41-9db4-51a9e6293f4b tempest-VolumesCloneTest-381177309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a45230d-7009-4a37-a865-9ec7fc9ff56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:47 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-293adc21-c89a-4c41-9db4-51a9e6293f4b tempest-VolumesCloneTest-381177309 None] Volume 807b4769-14df-4df3-8d61-39945fbe778e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-807b4769-14df-4df3-8d61-39945fbe778e', 'volume_size': 1}
Apr 02 10:30:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-293adc21-c89a-4c41-9db4-51a9e6293f4b tempest-VolumesCloneTest-381177309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-293adc21-c89a-4c41-9db4-51a9e6293f4b tempest-VolumesCloneTest-381177309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:47 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-293adc21-c89a-4c41-9db4-51a9e6293f4b tempest-VolumesCloneTest-381177309 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1672838224',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=807b4769-14df-4df3-8d61-39945fbe778e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab7692fddf954f8481e56710189e6687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:48Z,use_quota=True,user_id='c9d0509449404edbbaf5f544edb69b4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:30:47 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-293adc21-c89a-4c41-9db4-51a9e6293f4b tempest-VolumesCloneTest-381177309 None] Creating volume 807b4769-14df-4df3-8d61-39945fbe778e {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:30:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-293adc21-c89a-4c41-9db4-51a9e6293f4b tempest-VolumesCloneTest-381177309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-293adc21-c89a-4c41-9db4-51a9e6293f4b tempest-VolumesCloneTest-381177309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:47 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-293adc21-c89a-4c41-9db4-51a9e6293f4b tempest-VolumesCloneTest-381177309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:30:47 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-293adc21-c89a-4c41-9db4-51a9e6293f4b tempest-VolumesCloneTest-381177309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:30:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-293adc21-c89a-4c41-9db4-51a9e6293f4b tempest-VolumesCloneTest-381177309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:47 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-293adc21-c89a-4c41-9db4-51a9e6293f4b tempest-VolumesCloneTest-381177309 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:30:47 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-293adc21-c89a-4c41-9db4-51a9e6293f4b tempest-VolumesCloneTest-381177309 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:30:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-293adc21-c89a-4c41-9db4-51a9e6293f4b tempest-VolumesCloneTest-381177309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:47 devstack sudo[87927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e 1073741824
Apr 02 10:30:47 devstack sudo[87927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:48 devstack sudo[87927]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-293adc21-c89a-4c41-9db4-51a9e6293f4b tempest-VolumesCloneTest-381177309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e 1073741824" returned: 0 in 0.572s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-293adc21-c89a-4c41-9db4-51a9e6293f4b tempest-VolumesCloneTest-381177309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:48 devstack sudo[87932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e
Apr 02 10:30:48 devstack sudo[87932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:48 devstack sudo[87932]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-293adc21-c89a-4c41-9db4-51a9e6293f4b tempest-VolumesCloneTest-381177309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e" returned: 0 in 0.438s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:48 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-293adc21-c89a-4c41-9db4-51a9e6293f4b tempest-VolumesCloneTest-381177309 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:30:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-293adc21-c89a-4c41-9db4-51a9e6293f4b tempest-VolumesCloneTest-381177309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-293adc21-c89a-4c41-9db4-51a9e6293f4b tempest-VolumesCloneTest-381177309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a45230d-7009-4a37-a865-9ec7fc9ff56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-807b4769-14df-4df3-8d61-39945fbe778e', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-293adc21-c89a-4c41-9db4-51a9e6293f4b tempest-VolumesCloneTest-381177309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55519510-ce22-4411-ba2b-80099ae08bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:48 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-293adc21-c89a-4c41-9db4-51a9e6293f4b tempest-VolumesCloneTest-381177309 None] Volume volume-807b4769-14df-4df3-8d61-39945fbe778e (807b4769-14df-4df3-8d61-39945fbe778e): created successfully
Apr 02 10:30:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-293adc21-c89a-4c41-9db4-51a9e6293f4b tempest-VolumesCloneTest-381177309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55519510-ce22-4411-ba2b-80099ae08bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-293adc21-c89a-4c41-9db4-51a9e6293f4b tempest-VolumesCloneTest-381177309 None] Flow 'volume_create_manager' (1983f5d7-2ca8-458a-96dd-a5708088636d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:30:48 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-293adc21-c89a-4c41-9db4-51a9e6293f4b tempest-VolumesCloneTest-381177309 None] Created volume successfully.
Apr 02 10:30:48 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3a23106-8365-4527-9853-19e74c1b9732 tempest-VolumesActionsTest-1465184981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:30:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c3a23106-8365-4527-9853-19e74c1b9732 tempest-VolumesActionsTest-1465184981 None] Flow 'volume_create_manager' (c1fbce37-b9fd-454a-a858-9f31ef16a4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:30:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c3a23106-8365-4527-9853-19e74c1b9732 tempest-VolumesActionsTest-1465184981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37c93fbb-c734-4125-b2f1-35b95bbad7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c3a23106-8365-4527-9853-19e74c1b9732 tempest-VolumesActionsTest-1465184981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37c93fbb-c734-4125-b2f1-35b95bbad7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2090948698',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ba3da5-2579-4e41-b1fe-e53a554fb94d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892f2d2b52fc4b7ea9ae885eb7b92afd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:49Z,use_quota=True,user_id='97266187072c4eb489d18f89a64a5f9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c3a23106-8365-4527-9853-19e74c1b9732 tempest-VolumesActionsTest-1465184981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3483e53a-d7cb-4b7f-87c5-7ce5290191fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c3a23106-8365-4527-9853-19e74c1b9732 tempest-VolumesActionsTest-1465184981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3483e53a-d7cb-4b7f-87c5-7ce5290191fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c3a23106-8365-4527-9853-19e74c1b9732 tempest-VolumesActionsTest-1465184981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9afdae43-b258-4c9d-86f1-22d253ce9079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c3a23106-8365-4527-9853-19e74c1b9732 tempest-VolumesActionsTest-1465184981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9afdae43-b258-4c9d-86f1-22d253ce9079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73ba3da5-2579-4e41-b1fe-e53a554fb94d', 'volume_name': 'volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c3a23106-8365-4527-9853-19e74c1b9732 tempest-VolumesActionsTest-1465184981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86cc5370-77c8-477d-8688-e5c22beb069c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c3a23106-8365-4527-9853-19e74c1b9732 tempest-VolumesActionsTest-1465184981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86cc5370-77c8-477d-8688-e5c22beb069c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c3a23106-8365-4527-9853-19e74c1b9732 tempest-VolumesActionsTest-1465184981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a927d4-99b5-46ce-a8f2-c37911339cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:48 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-c3a23106-8365-4527-9853-19e74c1b9732 tempest-VolumesActionsTest-1465184981 None] Volume 73ba3da5-2579-4e41-b1fe-e53a554fb94d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d', 'volume_size': 1}
Apr 02 10:30:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-c3a23106-8365-4527-9853-19e74c1b9732 tempest-VolumesActionsTest-1465184981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-c3a23106-8365-4527-9853-19e74c1b9732 tempest-VolumesActionsTest-1465184981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:48 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-c3a23106-8365-4527-9853-19e74c1b9732 tempest-VolumesActionsTest-1465184981 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2090948698',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ba3da5-2579-4e41-b1fe-e53a554fb94d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892f2d2b52fc4b7ea9ae885eb7b92afd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:49Z,use_quota=True,user_id='97266187072c4eb489d18f89a64a5f9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:30:48 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-c3a23106-8365-4527-9853-19e74c1b9732 tempest-VolumesActionsTest-1465184981 None] Creating volume 73ba3da5-2579-4e41-b1fe-e53a554fb94d {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:30:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-c3a23106-8365-4527-9853-19e74c1b9732 tempest-VolumesActionsTest-1465184981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-c3a23106-8365-4527-9853-19e74c1b9732 tempest-VolumesActionsTest-1465184981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:48 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-c3a23106-8365-4527-9853-19e74c1b9732 tempest-VolumesActionsTest-1465184981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:30:48 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-c3a23106-8365-4527-9853-19e74c1b9732 tempest-VolumesActionsTest-1465184981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:30:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-c3a23106-8365-4527-9853-19e74c1b9732 tempest-VolumesActionsTest-1465184981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:48 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-c3a23106-8365-4527-9853-19e74c1b9732 tempest-VolumesActionsTest-1465184981 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:30:48 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-c3a23106-8365-4527-9853-19e74c1b9732 tempest-VolumesActionsTest-1465184981 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:30:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c3a23106-8365-4527-9853-19e74c1b9732 tempest-VolumesActionsTest-1465184981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:48 devstack sudo[87935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d 1073741824
Apr 02 10:30:48 devstack sudo[87935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:49 devstack sudo[87935]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c3a23106-8365-4527-9853-19e74c1b9732 tempest-VolumesActionsTest-1465184981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d 1073741824" returned: 0 in 0.481s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c3a23106-8365-4527-9853-19e74c1b9732 tempest-VolumesActionsTest-1465184981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:49 devstack sudo[87940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d
Apr 02 10:30:49 devstack sudo[87940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:49 devstack sudo[87940]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c3a23106-8365-4527-9853-19e74c1b9732 tempest-VolumesActionsTest-1465184981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d" returned: 0 in 0.440s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:49 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-c3a23106-8365-4527-9853-19e74c1b9732 tempest-VolumesActionsTest-1465184981 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:30:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-c3a23106-8365-4527-9853-19e74c1b9732 tempest-VolumesActionsTest-1465184981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:49 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c3a23106-8365-4527-9853-19e74c1b9732 tempest-VolumesActionsTest-1465184981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77a927d4-99b5-46ce-a8f2-c37911339cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:49 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c3a23106-8365-4527-9853-19e74c1b9732 tempest-VolumesActionsTest-1465184981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85c140d8-382e-468a-aaf7-c13533539b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:49 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-c3a23106-8365-4527-9853-19e74c1b9732 tempest-VolumesActionsTest-1465184981 None] Volume volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d (73ba3da5-2579-4e41-b1fe-e53a554fb94d): created successfully
Apr 02 10:30:49 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c3a23106-8365-4527-9853-19e74c1b9732 tempest-VolumesActionsTest-1465184981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85c140d8-382e-468a-aaf7-c13533539b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:49 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-c3a23106-8365-4527-9853-19e74c1b9732 tempest-VolumesActionsTest-1465184981 None] Flow 'volume_create_manager' (c1fbce37-b9fd-454a-a858-9f31ef16a4c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:30:49 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-c3a23106-8365-4527-9853-19e74c1b9732 tempest-VolumesActionsTest-1465184981 None] Created volume successfully.
Apr 02 10:30:50 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:30:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Flow 'volume_create_manager' (e8214370-75da-4ab8-85b7-4ef600480a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:30:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf74bdb9-d9ce-4600-a539-f4c1139c7b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf74bdb9-d9ce-4600-a539-f4c1139c7b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1409121400',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66d58111-5ac9-4870-8930-8d1ff992c660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab7692fddf954f8481e56710189e6687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:30:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=807b4769-14df-4df3-8d61-39945fbe778e,status='creating',terminated_at=None,updated_at=2026-04-02T08:30:50Z,use_quota=True,user_id='c9d0509449404edbbaf5f544edb69b4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a527f48d-ddec-407b-93ae-87602a900555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a527f48d-ddec-407b-93ae-87602a900555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced7f5a7-d8ab-44b0-85c1-54504e36d3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ced7f5a7-d8ab-44b0-85c1-54504e36d3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '66d58111-5ac9-4870-8930-8d1ff992c660', 'volume_name': 'volume-66d58111-5ac9-4870-8930-8d1ff992c660', 'volume_size': 2, 'source_volid': '807b4769-14df-4df3-8d61-39945fbe778e', 'source_volstatus': 'available'}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1876fc0d-66a7-42e0-9c3c-8f5f84bcb1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1876fc0d-66a7-42e0-9c3c-8f5f84bcb1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1e87417-8dfa-4477-aba8-5cc9dfdc529d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:50 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Volume 66d58111-5ac9-4870-8930-8d1ff992c660: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-66d58111-5ac9-4870-8930-8d1ff992c660', 'volume_size': 2, 'source_volid': '807b4769-14df-4df3-8d61-39945fbe778e', 'source_volstatus': 'available'}
Apr 02 10:30:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:50 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Cloning volume 807b4769-14df-4df3-8d61-39945fbe778e to volume 66d58111-5ac9-4870-8930-8d1ff992c660
Apr 02 10:30:50 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Creating offline snapshot 61d2b9dd-4b1a-4be2-af78-c3e48fed02a4 of volume 807b4769-14df-4df3-8d61-39945fbe778e {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:30:50 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[57661f13-5647-4323-8a58-4d9b6703e343]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:30:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:50 devstack sudo[87943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e
Apr 02 10:30:50 devstack sudo[87943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:50 devstack sudo[87943]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e" returned: 0 in 0.452s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e.61d2b9dd-4b1a-4be2-af78-c3e48fed02a4 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:50 devstack sudo[87948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e.61d2b9dd-4b1a-4be2-af78-c3e48fed02a4 1G
Apr 02 10:30:50 devstack sudo[87948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:51 devstack sudo[87948]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e.61d2b9dd-4b1a-4be2-af78-c3e48fed02a4 1G" returned: 0 in 0.505s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-807b4769-14df-4df3-8d61-39945fbe778e -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e.61d2b9dd-4b1a-4be2-af78-c3e48fed02a4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:51 devstack sudo[87954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-807b4769-14df-4df3-8d61-39945fbe778e -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e.61d2b9dd-4b1a-4be2-af78-c3e48fed02a4
Apr 02 10:30:51 devstack sudo[87954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:51 devstack sudo[87954]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-807b4769-14df-4df3-8d61-39945fbe778e -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e.61d2b9dd-4b1a-4be2-af78-c3e48fed02a4" returned: 0 in 0.481s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:51 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e.61d2b9dd-4b1a-4be2-af78-c3e48fed02a4 is being set with open permissions: ugo+rw
Apr 02 10:30:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e.61d2b9dd-4b1a-4be2-af78-c3e48fed02a4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:51 devstack sudo[87959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e.61d2b9dd-4b1a-4be2-af78-c3e48fed02a4
Apr 02 10:30:51 devstack sudo[87959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:52 devstack sudo[87959]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e.61d2b9dd-4b1a-4be2-af78-c3e48fed02a4" returned: 0 in 0.496s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:52 devstack sudo[87964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e.info
Apr 02 10:30:52 devstack sudo[87964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:52 devstack sudo[87964]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e.info" returned: 0 in 0.426s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:52 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e.info is being set with open permissions: ugo+rw
Apr 02 10:30:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:52 devstack sudo[87967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e.info
Apr 02 10:30:52 devstack sudo[87967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:52 devstack sudo[87967]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e.info" returned: 0 in 0.411s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:52 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Acquiring lock "cinder-quobyte-66d58111-5ac9-4870-8930-8d1ff992c660" by "_copy_volume_from_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:52 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Lock "cinder-quobyte-66d58111-5ac9-4870-8930-8d1ff992c660" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:52 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] snapshot: 61d2b9dd-4b1a-4be2-af78-c3e48fed02a4, volume: 66d58111-5ac9-4870-8930-8d1ff992c660,  {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 02 10:30:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:30:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:30:52 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:30:52 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:30:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:52 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fa3216-4e28-4215-8168-8ce9da4b6909]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:30:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e.61d2b9dd-4b1a-4be2-af78-c3e48fed02a4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:53 devstack sudo[87970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e.61d2b9dd-4b1a-4be2-af78-c3e48fed02a4
Apr 02 10:30:53 devstack sudo[87970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:53 devstack sudo[87970]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e.61d2b9dd-4b1a-4be2-af78-c3e48fed02a4" returned: 0 in 0.500s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:53 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-807b4769-14df-4df3-8d61-39945fbe778e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:30:53 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 02 10:30:53 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Creating direct copy from snapshot {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 02 10:30:53 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac489e48-397e-47fe-8fee-02b549785474]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:30:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:53 devstack sudo[87975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e
Apr 02 10:30:53 devstack sudo[87975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:53 devstack sudo[87975]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e" returned: 0 in 0.477s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:53 devstack cinder-volume[82102]: DEBUG cinder.utils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Path /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-66d58111-5ac9-4870-8930-8d1ff992c660 not found in is_blk_device check {{(pid=82102) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 02 10:30:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-66d58111-5ac9-4870-8930-8d1ff992c660 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:53 devstack sudo[87980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-66d58111-5ac9-4870-8930-8d1ff992c660
Apr 02 10:30:53 devstack sudo[87980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:55 devstack sudo[87980]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-66d58111-5ac9-4870-8930-8d1ff992c660" returned: 0 in 1.961s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:55 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1be954-2e9d-4699-8e58-d60771e6dc1a]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:30:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:55 devstack sudo[87993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e
Apr 02 10:30:55 devstack sudo[87993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:56 devstack sudo[87993]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e" returned: 0 in 0.620s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:56 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Image conversion details: src /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e, size 1024.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-66d58111-5ac9-4870-8930-8d1ff992c660 {{(pid=82102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 02 10:30:56 devstack cinder-volume[82102]: INFO cinder.image.image_utils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Converted 1024.00 MB image at 521.78 MB/s
Apr 02 10:30:56 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-66d58111-5ac9-4870-8930-8d1ff992c660 is being set with open permissions: ugo+rw
Apr 02 10:30:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-66d58111-5ac9-4870-8930-8d1ff992c660 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:56 devstack sudo[87998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-66d58111-5ac9-4870-8930-8d1ff992c660
Apr 02 10:30:56 devstack sudo[87998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:57 devstack sudo[87998]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-66d58111-5ac9-4870-8930-8d1ff992c660" returned: 0 in 0.499s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:57 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Lock "cinder-quobyte-66d58111-5ac9-4870-8930-8d1ff992c660" released by "_copy_volume_from_snapshot" :: held 4.102s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:57 devstack cinder-volume[82102]: DEBUG dbcounter [-] [82102] Writing DB stats cinder:SELECT=151,cinder:INSERT=53,cinder:UPDATE=194,cinder:DELETE=21 {{(pid=82102) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 02 10:30:57 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Acquiring lock "cinder-quobyte-61d2b9dd-4b1a-4be2-af78-c3e48fed02a4" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:57 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Lock "cinder-quobyte-61d2b9dd-4b1a-4be2-af78-c3e48fed02a4" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:57 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Deleting offline snapshot 61d2b9dd-4b1a-4be2-af78-c3e48fed02a4 of volume 807b4769-14df-4df3-8d61-39945fbe778e {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:30:57 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] snapshot_file for this snap is: volume-807b4769-14df-4df3-8d61-39945fbe778e.61d2b9dd-4b1a-4be2-af78-c3e48fed02a4 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:30:57 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4811b2-b85f-4d9e-8455-4abf5f62b47a]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:30:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e.61d2b9dd-4b1a-4be2-af78-c3e48fed02a4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:57 devstack sudo[88001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e.61d2b9dd-4b1a-4be2-af78-c3e48fed02a4
Apr 02 10:30:57 devstack sudo[88001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:57 devstack sudo[88001]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e.61d2b9dd-4b1a-4be2-af78-c3e48fed02a4" returned: 0 in 0.590s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:57 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-807b4769-14df-4df3-8d61-39945fbe778e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:30:57 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[16290413-22b1-4ad5-890e-b02b98956035]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:30:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:57 devstack sudo[88007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e
Apr 02 10:30:57 devstack sudo[88007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:58 devstack sudo[88007]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e" returned: 0 in 0.460s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e.61d2b9dd-4b1a-4be2-af78-c3e48fed02a4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:58 devstack sudo[88015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e.61d2b9dd-4b1a-4be2-af78-c3e48fed02a4
Apr 02 10:30:58 devstack sudo[88015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:58 devstack sudo[88015]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e.61d2b9dd-4b1a-4be2-af78-c3e48fed02a4" returned: 0 in 0.422s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e.61d2b9dd-4b1a-4be2-af78-c3e48fed02a4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:58 devstack sudo[88032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e.61d2b9dd-4b1a-4be2-af78-c3e48fed02a4
Apr 02 10:30:58 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:30:59 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root
Apr 02 10:30:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e.61d2b9dd-4b1a-4be2-af78-c3e48fed02a4" returned: 0 in 0.419s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:30:59 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Lock "cinder-quobyte-61d2b9dd-4b1a-4be2-af78-c3e48fed02a4" released by "_delete_snapshot" :: held 1.940s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:30:59 devstack cinder-volume[82102]: DEBUG dbcounter [-] [82102] Writing DB stats cinder:SELECT=151,cinder:UPDATE=245,cinder:INSERT=49,cinder:DELETE=15 {{(pid=82102) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 02 10:30:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.940s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:30:59 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1e87417-8dfa-4477-aba8-5cc9dfdc529d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66d58111-5ac9-4870-8930-8d1ff992c660', 'volume_size': 2, 'source_volid': '807b4769-14df-4df3-8d61-39945fbe778e', 'source_volstatus': 'available'}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:59 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd9c87f1-2ede-4824-9a2d-6eb3f348a9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:30:59 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Volume volume-66d58111-5ac9-4870-8930-8d1ff992c660 (66d58111-5ac9-4870-8930-8d1ff992c660): created successfully
Apr 02 10:30:59 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd9c87f1-2ede-4824-9a2d-6eb3f348a9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:30:59 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Flow 'volume_create_manager' (e8214370-75da-4ab8-85b7-4ef600480a43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:30:59 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-afa9c76d-7baa-499d-b5c1-74058daa51e8 tempest-VolumesCloneTest-381177309 None] Created volume successfully.
Apr 02 10:30:59 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-093722e6-398e-4d4b-a63a-3a06d21f7e43 tempest-VolumesCloneTest-381177309 None] Acquiring lock "cinder-66d58111-5ac9-4870-8930-8d1ff992c660-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:59 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-093722e6-398e-4d4b-a63a-3a06d21f7e43 tempest-VolumesCloneTest-381177309 None] Lock "cinder-66d58111-5ac9-4870-8930-8d1ff992c660-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:59 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-093722e6-398e-4d4b-a63a-3a06d21f7e43 tempest-VolumesCloneTest-381177309 None] Acquiring lock "cinder-quobyte-66d58111-5ac9-4870-8930-8d1ff992c660" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:30:59 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-093722e6-398e-4d4b-a63a-3a06d21f7e43 tempest-VolumesCloneTest-381177309 None] Lock "cinder-quobyte-66d58111-5ac9-4870-8930-8d1ff992c660" acquired by "delete_volume" :: waited 0.011s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:30:59 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c0a596-9091-4eeb-94e7-eb4ce4b7d34f]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:30:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-093722e6-398e-4d4b-a63a-3a06d21f7e43 tempest-VolumesCloneTest-381177309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-66d58111-5ac9-4870-8930-8d1ff992c660 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:30:59 devstack sudo[88035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-66d58111-5ac9-4870-8930-8d1ff992c660
Apr 02 10:30:59 devstack sudo[88035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:00 devstack sudo[88035]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-093722e6-398e-4d4b-a63a-3a06d21f7e43 tempest-VolumesCloneTest-381177309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-66d58111-5ac9-4870-8930-8d1ff992c660" returned: 0 in 0.479s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-093722e6-398e-4d4b-a63a-3a06d21f7e43 tempest-VolumesCloneTest-381177309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-66d58111-5ac9-4870-8930-8d1ff992c660 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:00 devstack sudo[88040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-66d58111-5ac9-4870-8930-8d1ff992c660
Apr 02 10:31:00 devstack sudo[88040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:00 devstack sudo[88040]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-093722e6-398e-4d4b-a63a-3a06d21f7e43 tempest-VolumesCloneTest-381177309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-66d58111-5ac9-4870-8930-8d1ff992c660" returned: 0 in 0.410s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:00 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-093722e6-398e-4d4b-a63a-3a06d21f7e43 tempest-VolumesCloneTest-381177309 None] Lock "cinder-quobyte-66d58111-5ac9-4870-8930-8d1ff992c660" released by "delete_volume" :: held 0.915s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:31:00 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-093722e6-398e-4d4b-a63a-3a06d21f7e43 tempest-VolumesCloneTest-381177309 None] Created reservations ['33347cde-feed-4b0e-a11c-e9b61244f2bf', 'f3293af7-3533-42ae-b6f8-65369fb9c1c0', '18ce5cbc-d5cf-4161-8079-fe7114a2b578', '17012439-8fb5-4de8-a948-c9c5f7b16940'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:31:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-093722e6-398e-4d4b-a63a-3a06d21f7e43 tempest-VolumesCloneTest-381177309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:31:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-093722e6-398e-4d4b-a63a-3a06d21f7e43 tempest-VolumesCloneTest-381177309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:31:00 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-093722e6-398e-4d4b-a63a-3a06d21f7e43 tempest-VolumesCloneTest-381177309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:31:00 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-093722e6-398e-4d4b-a63a-3a06d21f7e43 tempest-VolumesCloneTest-381177309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:31:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-093722e6-398e-4d4b-a63a-3a06d21f7e43 tempest-VolumesCloneTest-381177309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:31:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-093722e6-398e-4d4b-a63a-3a06d21f7e43 tempest-VolumesCloneTest-381177309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:00 devstack sudo[88043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:31:00 devstack sudo[88043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:00 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c481b394-305f-4159-8033-48177323fab6 tempest-VolumesCloneTest-381177309 None] Acquiring lock "cinder-807b4769-14df-4df3-8d61-39945fbe778e-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:31:00 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c481b394-305f-4159-8033-48177323fab6 tempest-VolumesCloneTest-381177309 None] Lock "cinder-807b4769-14df-4df3-8d61-39945fbe778e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:31:00 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c481b394-305f-4159-8033-48177323fab6 tempest-VolumesCloneTest-381177309 None] Acquiring lock "cinder-quobyte-807b4769-14df-4df3-8d61-39945fbe778e" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:31:00 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c481b394-305f-4159-8033-48177323fab6 tempest-VolumesCloneTest-381177309 None] Lock "cinder-quobyte-807b4769-14df-4df3-8d61-39945fbe778e" acquired by "delete_volume" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:31:00 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd108dd5-36f9-4ea8-8b73-ec510aa2bbab]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:31:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c481b394-305f-4159-8033-48177323fab6 tempest-VolumesCloneTest-381177309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:00 devstack sudo[88048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e
Apr 02 10:31:00 devstack sudo[88048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:01 devstack sudo[88043]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-093722e6-398e-4d4b-a63a-3a06d21f7e43 tempest-VolumesCloneTest-381177309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.487s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:01 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-093722e6-398e-4d4b-a63a-3a06d21f7e43 tempest-VolumesCloneTest-381177309 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:31:01 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-093722e6-398e-4d4b-a63a-3a06d21f7e43 tempest-VolumesCloneTest-381177309 None] Deleted volume successfully.
Apr 02 10:31:01 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-093722e6-398e-4d4b-a63a-3a06d21f7e43 tempest-VolumesCloneTest-381177309 None] Lock "cinder-66d58111-5ac9-4870-8930-8d1ff992c660-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:31:01 devstack sudo[88048]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c481b394-305f-4159-8033-48177323fab6 tempest-VolumesCloneTest-381177309 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e" returned: 0 in 0.497s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c481b394-305f-4159-8033-48177323fab6 tempest-VolumesCloneTest-381177309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:01 devstack sudo[88055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e
Apr 02 10:31:01 devstack sudo[88055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:01 devstack sudo[88055]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c481b394-305f-4159-8033-48177323fab6 tempest-VolumesCloneTest-381177309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-807b4769-14df-4df3-8d61-39945fbe778e" returned: 0 in 0.426s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:01 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c481b394-305f-4159-8033-48177323fab6 tempest-VolumesCloneTest-381177309 None] Lock "cinder-quobyte-807b4769-14df-4df3-8d61-39945fbe778e" released by "delete_volume" :: held 0.954s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:31:01 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-c481b394-305f-4159-8033-48177323fab6 tempest-VolumesCloneTest-381177309 None] Created reservations ['f42a3421-876f-4146-b21c-3af9359c65fd', 'c0d741a9-54d4-4d84-9487-c4d616668055', 'bd192f2a-9868-4316-a629-9936b1176da6', 'aa254352-ad40-4a5f-a27b-f93644e70192'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:31:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-c481b394-305f-4159-8033-48177323fab6 tempest-VolumesCloneTest-381177309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:31:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-c481b394-305f-4159-8033-48177323fab6 tempest-VolumesCloneTest-381177309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:31:01 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-c481b394-305f-4159-8033-48177323fab6 tempest-VolumesCloneTest-381177309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:31:01 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-c481b394-305f-4159-8033-48177323fab6 tempest-VolumesCloneTest-381177309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:31:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-c481b394-305f-4159-8033-48177323fab6 tempest-VolumesCloneTest-381177309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:31:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c481b394-305f-4159-8033-48177323fab6 tempest-VolumesCloneTest-381177309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:01 devstack sudo[88058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:31:01 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:02 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c481b394-305f-4159-8033-48177323fab6 tempest-VolumesCloneTest-381177309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.473s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:02 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-c481b394-305f-4159-8033-48177323fab6 tempest-VolumesCloneTest-381177309 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:31:02 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-c481b394-305f-4159-8033-48177323fab6 tempest-VolumesCloneTest-381177309 None] Deleted volume successfully.
Apr 02 10:31:02 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c481b394-305f-4159-8033-48177323fab6 tempest-VolumesCloneTest-381177309 None] Lock "cinder-807b4769-14df-4df3-8d61-39945fbe778e-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:31:04 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9b9cfff8-1422-4ae2-900c-19c020b1a6fa tempest-VolumesActionsTest-1465184981 None] Acquiring lock "cinder-73ba3da5-2579-4e41-b1fe-e53a554fb94d" by "attach_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:31:04 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9b9cfff8-1422-4ae2-900c-19c020b1a6fa tempest-VolumesActionsTest-1465184981 None] Lock "cinder-73ba3da5-2579-4e41-b1fe-e53a554fb94d" acquired by "attach_volume" :: waited 0.011s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:31:04 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-9b9cfff8-1422-4ae2-900c-19c020b1a6fa tempest-VolumesActionsTest-1465184981 None] Attaching volume 73ba3da5-2579-4e41-b1fe-e53a554fb94d to instance 01b465d6-59e3-49cf-bd6b-3ca32938d7a3 at mountpoint /dev/vdb on host None.
Apr 02 10:31:04 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-9b9cfff8-1422-4ae2-900c-19c020b1a6fa tempest-VolumesActionsTest-1465184981 None] Attach volume completed successfully.
Apr 02 10:31:04 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9b9cfff8-1422-4ae2-900c-19c020b1a6fa tempest-VolumesActionsTest-1465184981 None] Lock "cinder-73ba3da5-2579-4e41-b1fe-e53a554fb94d" released by "attach_volume" :: held 0.103s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:31:05 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:31:05 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Flow 'volume_create_manager' (9f0a3c19-609e-4a5b-a314-1fa58253fcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:31:05 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74ac53f5-9283-4021-9c7d-28b04e50b5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:31:05 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74ac53f5-9283-4021-9c7d-28b04e50b5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:31:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1931835753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5f5c8bbe8494d3090cead0d38e32d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:31:05Z,use_quota=True,user_id='a8c63322379349feb1f7dbd0b954b7f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:31:05 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4413052-f805-4df7-b900-43a8538cacb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:31:05 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4413052-f805-4df7-b900-43a8538cacb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:31:05 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64425afe-a548-41c9-932f-248ea8b861b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:31:05 devstack cinder-volume[82102]: DEBUG cinder.image.glance [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Creating Keystone auth plugin from conf {{(pid=82102) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 02 10:31:05 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64425afe-a548-41c9-932f-248ea8b861b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89', 'volume_name': 'volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89', 'volume_size': 1, 'image_id': '100d2cbf-7145-49cd-863b-c1e137045ce3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/100d2cbf-7145-49cd-863b-c1e137045ce3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e7bc1c1d4b5544979a3d9a5428cd3e5d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '100d2cbf-7145-49cd-863b-c1e137045ce3', 'created_at': datetime.datetime(2026, 4, 2, 8, 20, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 8, 20, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/100d2cbf-7145-49cd-863b-c1e137045ce3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f63634275b0>}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:31:05 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2be39680-d1ab-4ba5-b708-6d2a2a87439a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:31:05 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2be39680-d1ab-4ba5-b708-6d2a2a87439a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:31:05 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab97269-5196-413f-9b93-6ec8c42dbe28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:31:05 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Volume a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89', 'volume_size': 1, 'image_id': '100d2cbf-7145-49cd-863b-c1e137045ce3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/100d2cbf-7145-49cd-863b-c1e137045ce3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e7bc1c1d4b5544979a3d9a5428cd3e5d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '100d2cbf-7145-49cd-863b-c1e137045ce3', 'created_at': datetime.datetime(2026, 4, 2, 8, 20, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 8, 20, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/100d2cbf-7145-49cd-863b-c1e137045ce3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f63634275b0>}
Apr 02 10:31:05 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Trying to clone a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89 from image 100d2cbf-7145-49cd-863b-c1e137045ce3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/100d2cbf-7145-49cd-863b-c1e137045ce3', 'metadata': {}}]). {{(pid=82102) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 02 10:31:05 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_w69bxobxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82102) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 02 10:31:05 devstack cinder-volume[82102]: INFO cinder.image.image_utils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Image download 20.69 MB at 20.69 MB/s
Apr 02 10:31:05 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-0b2bdcfc-ca76-4921-b4d9-f0b5e059c959 tempest-VolumesActionsTest-1465184981 None] Acquiring lock "cinder-73ba3da5-2579-4e41-b1fe-e53a554fb94d-detach_volume" by "detach_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:31:05 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-0b2bdcfc-ca76-4921-b4d9-f0b5e059c959 tempest-VolumesActionsTest-1465184981 None] Lock "cinder-73ba3da5-2579-4e41-b1fe-e53a554fb94d-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:31:05 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-0b2bdcfc-ca76-4921-b4d9-f0b5e059c959 tempest-VolumesActionsTest-1465184981 None] Detaching volume 73ba3da5-2579-4e41-b1fe-e53a554fb94d from instance 01b465d6-59e3-49cf-bd6b-3ca32938d7a3.
Apr 02 10:31:05 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9c5785-b8cf-4e30-96a9-8b2cca3ece20]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:31:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_w69bxobxdevstack@QuobyteHD {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:05 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-0b2bdcfc-ca76-4921-b4d9-f0b5e059c959 tempest-VolumesActionsTest-1465184981 None] Detach volume completed successfully.
Apr 02 10:31:05 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-0b2bdcfc-ca76-4921-b4d9-f0b5e059c959 tempest-VolumesActionsTest-1465184981 None] Lock "cinder-73ba3da5-2579-4e41-b1fe-e53a554fb94d-detach_volume" released by "detach_volume" :: held 0.054s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:31:05 devstack sudo[88089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_w69bxobxdevstack@QuobyteHD
Apr 02 10:31:05 devstack sudo[88089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:06 devstack sudo[88089]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_w69bxobxdevstack@QuobyteHD" returned: 0 in 0.495s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:06 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Temporary image 100d2cbf-7145-49cd-863b-c1e137045ce3 is fetched for user a8c63322379349feb1f7dbd0b954b7f1. {{(pid=82102) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 02 10:31:06 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[951fc13e-b6fc-40f5-a965-625b8f4b249c]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:31:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_w69bxobxdevstack@QuobyteHD {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:06 devstack sudo[88094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_w69bxobxdevstack@QuobyteHD
Apr 02 10:31:06 devstack sudo[88094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:06 devstack sudo[88094]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_w69bxobxdevstack@QuobyteHD" returned: 0 in 0.462s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:31:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:31:06 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:31:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1931835753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5f5c8bbe8494d3090cead0d38e32d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:31:05Z,use_quota=True,user_id='a8c63322379349feb1f7dbd0b954b7f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:31:06 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Creating volume a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:31:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:31:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:31:06 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:31:06 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:31:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:31:06 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:31:06 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:31:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:06 devstack sudo[88099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89 1073741824
Apr 02 10:31:06 devstack sudo[88099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:07 devstack sudo[88099]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89 1073741824" returned: 0 in 0.462s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:07 devstack sudo[88104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89
Apr 02 10:31:07 devstack sudo[88104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:07 devstack sudo[88104]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89" returned: 0 in 0.521s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:07 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:31:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:31:07 devstack cinder-volume[82102]: DEBUG cinder.volume.volume_utils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Attempting download of 100d2cbf-7145-49cd-863b-c1e137045ce3 ((None, [{'url': 'file:///opt/stack/data/glance/images/100d2cbf-7145-49cd-863b-c1e137045ce3', 'metadata': {}}])) to volume a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89. {{(pid=82102) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 02 10:31:07 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ba0b9b-b2f0-4beb-8a58-4a84c35ff32e]: (4, 'raw') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:31:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_100d2cbf-7145-49cd-863b-c1e137045ce3_aht2ikdq {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:07 devstack sudo[88134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_100d2cbf-7145-49cd-863b-c1e137045ce3_aht2ikdq
Apr 02 10:31:07 devstack sudo[88134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:08 devstack sudo[88134]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_100d2cbf-7145-49cd-863b-c1e137045ce3_aht2ikdq" returned: 0 in 0.482s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_100d2cbf-7145-49cd-863b-c1e137045ce3_aht2ikdq {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:08 devstack sudo[88139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_100d2cbf-7145-49cd-863b-c1e137045ce3_aht2ikdq
Apr 02 10:31:08 devstack sudo[88139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:08 devstack sudo[88139]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_100d2cbf-7145-49cd-863b-c1e137045ce3_aht2ikdq" returned: 1 in 0.475s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_100d2cbf-7145-49cd-863b-c1e137045ce3_aht2ikdq' failed. Not Retrying. {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 02 10:31:08 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bc7e4b-8b4c-451b-a6fb-04a6372f0711]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:31:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_w69bxobxdevstack@QuobyteHD {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:08 devstack sudo[88143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_w69bxobxdevstack@QuobyteHD
Apr 02 10:31:08 devstack sudo[88143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:09 devstack sudo[88143]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_w69bxobxdevstack@QuobyteHD" returned: 0 in 0.516s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:09 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] 100d2cbf-7145-49cd-863b-c1e137045ce3 was qcow2, converting to raw {{(pid=82102) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 02 10:31:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_w69bxobxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:09 devstack sudo[88149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_w69bxobxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89
Apr 02 10:31:09 devstack sudo[88149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:09 devstack sudo[88149]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_w69bxobxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89" returned: 0 in 0.867s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:09 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_w69bxobxdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89 {{(pid=82102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 02 10:31:09 devstack cinder-volume[82102]: INFO cinder.image.image_utils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Converted 112.00 MB image at 112.00 MB/s
Apr 02 10:31:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:10 devstack sudo[88156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89 1G
Apr 02 10:31:10 devstack sudo[88156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:10 devstack sudo[88156]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89 1G" returned: 0 in 0.421s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:10 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffe410e-a00b-49f7-a5ef-53257707745f]: (4, 'raw') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:31:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:10 devstack sudo[88161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89
Apr 02 10:31:10 devstack sudo[88161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:10 devstack sudo[88161]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89" returned: 0 in 0.466s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:10 devstack sudo[88165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89
Apr 02 10:31:10 devstack sudo[88165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:11 devstack sudo[88165]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89" returned: 1 in 0.484s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89' failed. Not Retrying. {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 02 10:31:11 devstack cinder-volume[82102]: DEBUG cinder.volume.volume_utils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Downloaded image 100d2cbf-7145-49cd-863b-c1e137045ce3 ((None, [{'url': 'file:///opt/stack/data/glance/images/100d2cbf-7145-49cd-863b-c1e137045ce3', 'metadata': {}}])) to volume a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89 successfully. {{(pid=82102) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 02 10:31:11 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Temporary image 100d2cbf-7145-49cd-863b-c1e137045ce3 for user a8c63322379349feb1f7dbd0b954b7f1 is deleted. {{(pid=82102) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 02 10:31:11 devstack cinder-volume[82102]: DEBUG cinder.volume.volume_utils [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Marking volume a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89 as bootable. {{(pid=82102) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 02 10:31:11 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Copying metadata from image 100d2cbf-7145-49cd-863b-c1e137045ce3 to a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89. {{(pid=82102) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 02 10:31:11 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Creating volume glance metadata for volume a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89 backed by image 100d2cbf-7145-49cd-863b-c1e137045ce3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '100d2cbf-7145-49cd-863b-c1e137045ce3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82102) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 02 10:31:11 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab97269-5196-413f-9b93-6ec8c42dbe28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89', 'volume_size': 1, 'image_id': '100d2cbf-7145-49cd-863b-c1e137045ce3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/100d2cbf-7145-49cd-863b-c1e137045ce3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e7bc1c1d4b5544979a3d9a5428cd3e5d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '100d2cbf-7145-49cd-863b-c1e137045ce3', 'created_at': datetime.datetime(2026, 4, 2, 8, 20, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 8, 20, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/100d2cbf-7145-49cd-863b-c1e137045ce3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f63634275b0>}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:31:11 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fde46599-0f75-41ea-b1f2-05c57d704c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:31:11 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Volume volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89 (a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89): created successfully
Apr 02 10:31:11 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fde46599-0f75-41ea-b1f2-05c57d704c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:31:11 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Flow 'volume_create_manager' (9f0a3c19-609e-4a5b-a314-1fa58253fcda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:31:11 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-88126f58-92e7-4da9-9579-be67392e66d8 tempest-VolumesExtendTest-374819619 None] Created volume successfully.
Apr 02 10:31:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-593a5aef-381d-4753-b60e-7db1e9ba5ce0 tempest-VolumesExtendTest-374819619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:31:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-593a5aef-381d-4753-b60e-7db1e9ba5ce0 tempest-VolumesExtendTest-374819619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:31:12 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3c8b29-973d-401d-8c81-d9cf6ee696b5]: (4, 'raw') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:31:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-593a5aef-381d-4753-b60e-7db1e9ba5ce0 tempest-VolumesExtendTest-374819619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:12 devstack sudo[88172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89
Apr 02 10:31:12 devstack sudo[88172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:13 devstack sudo[88172]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-593a5aef-381d-4753-b60e-7db1e9ba5ce0 tempest-VolumesExtendTest-374819619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89" returned: 0 in 0.466s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-593a5aef-381d-4753-b60e-7db1e9ba5ce0 tempest-VolumesExtendTest-374819619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:13 devstack sudo[88176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89
Apr 02 10:31:13 devstack sudo[88176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:13 devstack sudo[88176]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-593a5aef-381d-4753-b60e-7db1e9ba5ce0 tempest-VolumesExtendTest-374819619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89" returned: 1 in 0.488s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-593a5aef-381d-4753-b60e-7db1e9ba5ce0 tempest-VolumesExtendTest-374819619 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89' failed. Not Retrying. {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 02 10:31:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-593a5aef-381d-4753-b60e-7db1e9ba5ce0 tempest-VolumesExtendTest-374819619 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89 2G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-593a5aef-381d-4753-b60e-7db1e9ba5ce0 tempest-VolumesExtendTest-374819619 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89 2G" returned: 0 in 0.048s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-593a5aef-381d-4753-b60e-7db1e9ba5ce0 tempest-VolumesExtendTest-374819619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.037s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:31:13 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-593a5aef-381d-4753-b60e-7db1e9ba5ce0 tempest-VolumesExtendTest-374819619 None] Extend volume completed successfully.
Apr 02 10:31:14 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-87c2b5ba-060d-489a-8c3f-bb1fd2a6aff2 tempest-VolumesExtendTest-374819619 None] Acquiring lock "cinder-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:31:14 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-87c2b5ba-060d-489a-8c3f-bb1fd2a6aff2 tempest-VolumesExtendTest-374819619 None] Lock "cinder-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:31:14 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-87c2b5ba-060d-489a-8c3f-bb1fd2a6aff2 tempest-VolumesExtendTest-374819619 None] Acquiring lock "cinder-quobyte-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:31:14 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-87c2b5ba-060d-489a-8c3f-bb1fd2a6aff2 tempest-VolumesExtendTest-374819619 None] Lock "cinder-quobyte-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89" acquired by "delete_volume" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:31:14 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[743e8400-3e21-421c-a7df-0de54e9d9077]: (4, 'raw') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:31:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-87c2b5ba-060d-489a-8c3f-bb1fd2a6aff2 tempest-VolumesExtendTest-374819619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:14 devstack sudo[88186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89
Apr 02 10:31:14 devstack sudo[88186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:15 devstack sudo[88186]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-87c2b5ba-060d-489a-8c3f-bb1fd2a6aff2 tempest-VolumesExtendTest-374819619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89" returned: 0 in 0.468s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-87c2b5ba-060d-489a-8c3f-bb1fd2a6aff2 tempest-VolumesExtendTest-374819619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:15 devstack sudo[88190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89
Apr 02 10:31:15 devstack sudo[88190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:15 devstack sudo[88190]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-87c2b5ba-060d-489a-8c3f-bb1fd2a6aff2 tempest-VolumesExtendTest-374819619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89" returned: 1 in 0.470s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-87c2b5ba-060d-489a-8c3f-bb1fd2a6aff2 tempest-VolumesExtendTest-374819619 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89' failed. Not Retrying. {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 02 10:31:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-87c2b5ba-060d-489a-8c3f-bb1fd2a6aff2 tempest-VolumesExtendTest-374819619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:15 devstack sudo[88195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89
Apr 02 10:31:15 devstack sudo[88195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:16 devstack sudo[88195]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-87c2b5ba-060d-489a-8c3f-bb1fd2a6aff2 tempest-VolumesExtendTest-374819619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89" returned: 0 in 0.413s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:16 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-87c2b5ba-060d-489a-8c3f-bb1fd2a6aff2 tempest-VolumesExtendTest-374819619 None] Lock "cinder-quobyte-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89" released by "delete_volume" :: held 1.395s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:31:16 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-87c2b5ba-060d-489a-8c3f-bb1fd2a6aff2 tempest-VolumesExtendTest-374819619 None] Created reservations ['6886c3ad-5b76-4b00-912a-34ac39ac70af', '308507b4-1180-4ace-bc39-ba2882891733', '2406745b-ef5f-43a1-bb40-fd34e51e04f8', 'fa866999-f62e-441b-b1fb-978133a57869'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:31:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-87c2b5ba-060d-489a-8c3f-bb1fd2a6aff2 tempest-VolumesExtendTest-374819619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:31:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-87c2b5ba-060d-489a-8c3f-bb1fd2a6aff2 tempest-VolumesExtendTest-374819619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:31:16 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-87c2b5ba-060d-489a-8c3f-bb1fd2a6aff2 tempest-VolumesExtendTest-374819619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:31:16 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-87c2b5ba-060d-489a-8c3f-bb1fd2a6aff2 tempest-VolumesExtendTest-374819619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:31:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-87c2b5ba-060d-489a-8c3f-bb1fd2a6aff2 tempest-VolumesExtendTest-374819619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:31:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-87c2b5ba-060d-489a-8c3f-bb1fd2a6aff2 tempest-VolumesExtendTest-374819619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:16 devstack sudo[88198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:31:16 devstack sudo[88198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:16 devstack sudo[88198]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-87c2b5ba-060d-489a-8c3f-bb1fd2a6aff2 tempest-VolumesExtendTest-374819619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.387s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:16 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-87c2b5ba-060d-489a-8c3f-bb1fd2a6aff2 tempest-VolumesExtendTest-374819619 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:31:16 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-87c2b5ba-060d-489a-8c3f-bb1fd2a6aff2 tempest-VolumesExtendTest-374819619 None] Deleted volume successfully.
Apr 02 10:31:16 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-87c2b5ba-060d-489a-8c3f-bb1fd2a6aff2 tempest-VolumesExtendTest-374819619 None] Lock "cinder-a8c1d82b-f72b-4e5b-84c1-2a3a2cbb4d89-delete_volume" released by "delete_volume" :: held 1.915s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:31:17 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-962e6312-a312-4c4c-8954-eec3be659ecb tempest-VolumesExtendTest-374819619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:31:17 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-962e6312-a312-4c4c-8954-eec3be659ecb tempest-VolumesExtendTest-374819619 None] Flow 'volume_create_manager' (3369f37f-9391-4ad4-982d-7eb15fa43352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:31:17 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-962e6312-a312-4c4c-8954-eec3be659ecb tempest-VolumesExtendTest-374819619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d149933-a1ed-43e7-aa85-c3b30ae7f173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:31:17 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-962e6312-a312-4c4c-8954-eec3be659ecb tempest-VolumesExtendTest-374819619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d149933-a1ed-43e7-aa85-c3b30ae7f173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-397782422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f68d3f-0084-4d32-9faa-34b754a2c1d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5f5c8bbe8494d3090cead0d38e32d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:31:17Z,use_quota=True,user_id='a8c63322379349feb1f7dbd0b954b7f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:31:17 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-962e6312-a312-4c4c-8954-eec3be659ecb tempest-VolumesExtendTest-374819619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e280285-39e2-4a34-a214-493bd1294989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:31:17 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-962e6312-a312-4c4c-8954-eec3be659ecb tempest-VolumesExtendTest-374819619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e280285-39e2-4a34-a214-493bd1294989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:31:17 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-962e6312-a312-4c4c-8954-eec3be659ecb tempest-VolumesExtendTest-374819619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ffc10ff-86e3-4a55-8980-d8e5d9b6a733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:31:17 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-962e6312-a312-4c4c-8954-eec3be659ecb tempest-VolumesExtendTest-374819619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ffc10ff-86e3-4a55-8980-d8e5d9b6a733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0f68d3f-0084-4d32-9faa-34b754a2c1d8', 'volume_name': 'volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:31:17 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-962e6312-a312-4c4c-8954-eec3be659ecb tempest-VolumesExtendTest-374819619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd780af0-3fb5-4505-b86d-5e276d2ceedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:31:17 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-962e6312-a312-4c4c-8954-eec3be659ecb tempest-VolumesExtendTest-374819619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd780af0-3fb5-4505-b86d-5e276d2ceedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:31:17 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-962e6312-a312-4c4c-8954-eec3be659ecb tempest-VolumesExtendTest-374819619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2de4d6d-f289-4868-83f8-dc23be6890f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:31:17 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-962e6312-a312-4c4c-8954-eec3be659ecb tempest-VolumesExtendTest-374819619 None] Volume d0f68d3f-0084-4d32-9faa-34b754a2c1d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8', 'volume_size': 1}
Apr 02 10:31:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-962e6312-a312-4c4c-8954-eec3be659ecb tempest-VolumesExtendTest-374819619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:31:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-962e6312-a312-4c4c-8954-eec3be659ecb tempest-VolumesExtendTest-374819619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:31:17 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-962e6312-a312-4c4c-8954-eec3be659ecb tempest-VolumesExtendTest-374819619 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-397782422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f68d3f-0084-4d32-9faa-34b754a2c1d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5f5c8bbe8494d3090cead0d38e32d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:31:17Z,use_quota=True,user_id='a8c63322379349feb1f7dbd0b954b7f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:31:17 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-962e6312-a312-4c4c-8954-eec3be659ecb tempest-VolumesExtendTest-374819619 None] Creating volume d0f68d3f-0084-4d32-9faa-34b754a2c1d8 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:31:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-962e6312-a312-4c4c-8954-eec3be659ecb tempest-VolumesExtendTest-374819619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:31:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-962e6312-a312-4c4c-8954-eec3be659ecb tempest-VolumesExtendTest-374819619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:31:17 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-962e6312-a312-4c4c-8954-eec3be659ecb tempest-VolumesExtendTest-374819619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:31:17 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-962e6312-a312-4c4c-8954-eec3be659ecb tempest-VolumesExtendTest-374819619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:31:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-962e6312-a312-4c4c-8954-eec3be659ecb tempest-VolumesExtendTest-374819619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:31:17 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-962e6312-a312-4c4c-8954-eec3be659ecb tempest-VolumesExtendTest-374819619 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:31:17 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-962e6312-a312-4c4c-8954-eec3be659ecb tempest-VolumesExtendTest-374819619 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:31:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-962e6312-a312-4c4c-8954-eec3be659ecb tempest-VolumesExtendTest-374819619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:17 devstack sudo[88201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8 1073741824
Apr 02 10:31:17 devstack sudo[88201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:17 devstack sudo[88201]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-962e6312-a312-4c4c-8954-eec3be659ecb tempest-VolumesExtendTest-374819619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8 1073741824" returned: 0 in 0.481s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-962e6312-a312-4c4c-8954-eec3be659ecb tempest-VolumesExtendTest-374819619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:17 devstack sudo[88206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8
Apr 02 10:31:17 devstack sudo[88206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:18 devstack sudo[88206]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-962e6312-a312-4c4c-8954-eec3be659ecb tempest-VolumesExtendTest-374819619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8" returned: 0 in 0.422s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:18 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-962e6312-a312-4c4c-8954-eec3be659ecb tempest-VolumesExtendTest-374819619 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:31:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-962e6312-a312-4c4c-8954-eec3be659ecb tempest-VolumesExtendTest-374819619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:31:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-962e6312-a312-4c4c-8954-eec3be659ecb tempest-VolumesExtendTest-374819619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2de4d6d-f289-4868-83f8-dc23be6890f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:31:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-962e6312-a312-4c4c-8954-eec3be659ecb tempest-VolumesExtendTest-374819619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bdb16f9-9e37-466a-837b-7b077c3957c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:31:18 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-962e6312-a312-4c4c-8954-eec3be659ecb tempest-VolumesExtendTest-374819619 None] Volume volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8 (d0f68d3f-0084-4d32-9faa-34b754a2c1d8): created successfully
Apr 02 10:31:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-962e6312-a312-4c4c-8954-eec3be659ecb tempest-VolumesExtendTest-374819619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bdb16f9-9e37-466a-837b-7b077c3957c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:31:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-962e6312-a312-4c4c-8954-eec3be659ecb tempest-VolumesExtendTest-374819619 None] Flow 'volume_create_manager' (3369f37f-9391-4ad4-982d-7eb15fa43352) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:31:18 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-962e6312-a312-4c4c-8954-eec3be659ecb tempest-VolumesExtendTest-374819619 None] Created volume successfully.
Apr 02 10:31:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-940c41b4-08da-4e4c-8359-6c9d769039cb tempest-VolumesExtendTest-374819619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:31:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-940c41b4-08da-4e4c-8359-6c9d769039cb tempest-VolumesExtendTest-374819619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:31:19 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-940c41b4-08da-4e4c-8359-6c9d769039cb tempest-VolumesExtendTest-374819619 None] Creating offline snapshot 57ced19b-7b1d-4575-b00b-aa78dcdf5c9d of volume d0f68d3f-0084-4d32-9faa-34b754a2c1d8 {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:31:19 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[90dd5517-cf8c-4b85-a663-74b29e8e11eb]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:31:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-940c41b4-08da-4e4c-8359-6c9d769039cb tempest-VolumesExtendTest-374819619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:19 devstack sudo[88209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8
Apr 02 10:31:19 devstack sudo[88209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:20 devstack sudo[88209]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-940c41b4-08da-4e4c-8359-6c9d769039cb tempest-VolumesExtendTest-374819619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8" returned: 0 in 0.493s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-940c41b4-08da-4e4c-8359-6c9d769039cb tempest-VolumesExtendTest-374819619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8.57ced19b-7b1d-4575-b00b-aa78dcdf5c9d 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:20 devstack sudo[88215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8.57ced19b-7b1d-4575-b00b-aa78dcdf5c9d 1G
Apr 02 10:31:20 devstack sudo[88215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:20 devstack sudo[88215]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-940c41b4-08da-4e4c-8359-6c9d769039cb tempest-VolumesExtendTest-374819619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8.57ced19b-7b1d-4575-b00b-aa78dcdf5c9d 1G" returned: 0 in 0.520s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-940c41b4-08da-4e4c-8359-6c9d769039cb tempest-VolumesExtendTest-374819619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8.57ced19b-7b1d-4575-b00b-aa78dcdf5c9d {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:20 devstack sudo[88235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8.57ced19b-7b1d-4575-b00b-aa78dcdf5c9d
Apr 02 10:31:20 devstack sudo[88235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:21 devstack sudo[88235]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-940c41b4-08da-4e4c-8359-6c9d769039cb tempest-VolumesExtendTest-374819619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8.57ced19b-7b1d-4575-b00b-aa78dcdf5c9d" returned: 0 in 0.473s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:21 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-940c41b4-08da-4e4c-8359-6c9d769039cb tempest-VolumesExtendTest-374819619 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8.57ced19b-7b1d-4575-b00b-aa78dcdf5c9d is being set with open permissions: ugo+rw
Apr 02 10:31:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-940c41b4-08da-4e4c-8359-6c9d769039cb tempest-VolumesExtendTest-374819619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8.57ced19b-7b1d-4575-b00b-aa78dcdf5c9d {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:21 devstack sudo[88241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8.57ced19b-7b1d-4575-b00b-aa78dcdf5c9d
Apr 02 10:31:21 devstack sudo[88241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:21 devstack sudo[88241]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-940c41b4-08da-4e4c-8359-6c9d769039cb tempest-VolumesExtendTest-374819619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8.57ced19b-7b1d-4575-b00b-aa78dcdf5c9d" returned: 0 in 0.397s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-940c41b4-08da-4e4c-8359-6c9d769039cb tempest-VolumesExtendTest-374819619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:21 devstack sudo[88244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8.info
Apr 02 10:31:21 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:21 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-940c41b4-08da-4e4c-8359-6c9d769039cb tempest-VolumesExtendTest-374819619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8.info" returned: 0 in 0.434s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:21 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-940c41b4-08da-4e4c-8359-6c9d769039cb tempest-VolumesExtendTest-374819619 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8.info is being set with open permissions: ugo+rw
Apr 02 10:31:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-940c41b4-08da-4e4c-8359-6c9d769039cb tempest-VolumesExtendTest-374819619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:21 devstack sudo[88247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8.info
Apr 02 10:31:21 devstack sudo[88247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:22 devstack sudo[88247]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-940c41b4-08da-4e4c-8359-6c9d769039cb tempest-VolumesExtendTest-374819619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8.info" returned: 0 in 0.408s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-940c41b4-08da-4e4c-8359-6c9d769039cb tempest-VolumesExtendTest-374819619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.787s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:31:22 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-940c41b4-08da-4e4c-8359-6c9d769039cb tempest-VolumesExtendTest-374819619 None] Create snapshot completed successfully
Apr 02 10:31:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-9f997d41-b9bc-4be9-83f4-7a3c4bdb16ea tempest-VolumesExtendTest-374819619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:31:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-9f997d41-b9bc-4be9-83f4-7a3c4bdb16ea tempest-VolumesExtendTest-374819619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:31:22 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd46ece9-d7cd-4481-9937-0bf7eee92f5b]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:31:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9f997d41-b9bc-4be9-83f4-7a3c4bdb16ea tempest-VolumesExtendTest-374819619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:22 devstack sudo[88252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8
Apr 02 10:31:22 devstack sudo[88252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:23 devstack sudo[88252]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9f997d41-b9bc-4be9-83f4-7a3c4bdb16ea tempest-VolumesExtendTest-374819619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8" returned: 0 in 0.470s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9f997d41-b9bc-4be9-83f4-7a3c4bdb16ea tempest-VolumesExtendTest-374819619 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8.57ced19b-7b1d-4575-b00b-aa78dcdf5c9d 2G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9f997d41-b9bc-4be9-83f4-7a3c4bdb16ea tempest-VolumesExtendTest-374819619 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8.57ced19b-7b1d-4575-b00b-aa78dcdf5c9d 2G" returned: 0 in 0.063s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-9f997d41-b9bc-4be9-83f4-7a3c4bdb16ea tempest-VolumesExtendTest-374819619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.553s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:31:23 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-9f997d41-b9bc-4be9-83f4-7a3c4bdb16ea tempest-VolumesExtendTest-374819619 None] Extend volume completed successfully.
Apr 02 10:31:23 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-77250d52-29a8-434d-b3a9-2ef9b6d0a950 tempest-VolumesExtendTest-374819619 None] Acquiring lock "cinder-57ced19b-7b1d-4575-b00b-aa78dcdf5c9d-delete_snapshot" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:31:23 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-77250d52-29a8-434d-b3a9-2ef9b6d0a950 tempest-VolumesExtendTest-374819619 None] Lock "cinder-57ced19b-7b1d-4575-b00b-aa78dcdf5c9d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:31:23 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-77250d52-29a8-434d-b3a9-2ef9b6d0a950 tempest-VolumesExtendTest-374819619 None] Acquiring lock "cinder-quobyte-d0f68d3f-0084-4d32-9faa-34b754a2c1d8" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:31:23 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-77250d52-29a8-434d-b3a9-2ef9b6d0a950 tempest-VolumesExtendTest-374819619 None] Lock "cinder-quobyte-d0f68d3f-0084-4d32-9faa-34b754a2c1d8" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:31:23 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-77250d52-29a8-434d-b3a9-2ef9b6d0a950 tempest-VolumesExtendTest-374819619 None] Acquiring lock "cinder-quobyte-57ced19b-7b1d-4575-b00b-aa78dcdf5c9d" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:31:23 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-77250d52-29a8-434d-b3a9-2ef9b6d0a950 tempest-VolumesExtendTest-374819619 None] Lock "cinder-quobyte-57ced19b-7b1d-4575-b00b-aa78dcdf5c9d" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:31:23 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-77250d52-29a8-434d-b3a9-2ef9b6d0a950 tempest-VolumesExtendTest-374819619 None] Deleting offline snapshot 57ced19b-7b1d-4575-b00b-aa78dcdf5c9d of volume d0f68d3f-0084-4d32-9faa-34b754a2c1d8 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:31:23 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-77250d52-29a8-434d-b3a9-2ef9b6d0a950 tempest-VolumesExtendTest-374819619 None] snapshot_file for this snap is: volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8.57ced19b-7b1d-4575-b00b-aa78dcdf5c9d {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:31:23 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[71abb678-52d7-482b-8a5a-c2b2df233aa0]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:31:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-77250d52-29a8-434d-b3a9-2ef9b6d0a950 tempest-VolumesExtendTest-374819619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8.57ced19b-7b1d-4575-b00b-aa78dcdf5c9d {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:24 devstack sudo[88261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8.57ced19b-7b1d-4575-b00b-aa78dcdf5c9d
Apr 02 10:31:24 devstack sudo[88261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:24 devstack sudo[88261]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-77250d52-29a8-434d-b3a9-2ef9b6d0a950 tempest-VolumesExtendTest-374819619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8.57ced19b-7b1d-4575-b00b-aa78dcdf5c9d" returned: 0 in 0.617s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:24 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-77250d52-29a8-434d-b3a9-2ef9b6d0a950 tempest-VolumesExtendTest-374819619 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:31:24 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bac556-73fd-486b-85bd-ad28bbb2d513]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:31:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-77250d52-29a8-434d-b3a9-2ef9b6d0a950 tempest-VolumesExtendTest-374819619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:24 devstack sudo[88292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8
Apr 02 10:31:24 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:25 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-77250d52-29a8-434d-b3a9-2ef9b6d0a950 tempest-VolumesExtendTest-374819619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8" returned: 0 in 0.517s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-77250d52-29a8-434d-b3a9-2ef9b6d0a950 tempest-VolumesExtendTest-374819619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8.57ced19b-7b1d-4575-b00b-aa78dcdf5c9d {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:25 devstack sudo[88299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8.57ced19b-7b1d-4575-b00b-aa78dcdf5c9d
Apr 02 10:31:25 devstack sudo[88299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:25 devstack sudo[88299]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-77250d52-29a8-434d-b3a9-2ef9b6d0a950 tempest-VolumesExtendTest-374819619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8.57ced19b-7b1d-4575-b00b-aa78dcdf5c9d" returned: 0 in 0.500s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-77250d52-29a8-434d-b3a9-2ef9b6d0a950 tempest-VolumesExtendTest-374819619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8.57ced19b-7b1d-4575-b00b-aa78dcdf5c9d {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:25 devstack sudo[88304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8.57ced19b-7b1d-4575-b00b-aa78dcdf5c9d
Apr 02 10:31:25 devstack sudo[88304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:26 devstack sudo[88304]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-77250d52-29a8-434d-b3a9-2ef9b6d0a950 tempest-VolumesExtendTest-374819619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8.57ced19b-7b1d-4575-b00b-aa78dcdf5c9d" returned: 0 in 0.431s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:26 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-77250d52-29a8-434d-b3a9-2ef9b6d0a950 tempest-VolumesExtendTest-374819619 None] Lock "cinder-quobyte-57ced19b-7b1d-4575-b00b-aa78dcdf5c9d" released by "_delete_snapshot" :: held 2.128s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:31:26 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-77250d52-29a8-434d-b3a9-2ef9b6d0a950 tempest-VolumesExtendTest-374819619 None] Lock "cinder-quobyte-d0f68d3f-0084-4d32-9faa-34b754a2c1d8" released by "delete_snapshot" :: held 2.143s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:31:26 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-77250d52-29a8-434d-b3a9-2ef9b6d0a950 tempest-VolumesExtendTest-374819619 None] Created reservations ['e7e690de-e352-4157-bcad-ef47bbd327d4', '8197097d-b19e-4a79-89bb-f36c7dbb37d9', '396311c0-d65e-49fa-8c27-f65506bf43bf', '2480035e-0739-48f9-879b-74499d7f2dd3'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:31:26 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-77250d52-29a8-434d-b3a9-2ef9b6d0a950 tempest-VolumesExtendTest-374819619 None] Delete snapshot completed successfully.
Apr 02 10:31:26 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-77250d52-29a8-434d-b3a9-2ef9b6d0a950 tempest-VolumesExtendTest-374819619 None] Lock "cinder-57ced19b-7b1d-4575-b00b-aa78dcdf5c9d-delete_snapshot" released by "delete_snapshot" :: held 2.236s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:31:26 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-09374c3b-42e1-469f-9907-2425659079df tempest-VolumesActionsTest-1465184981 None] Acquiring lock "cinder-73ba3da5-2579-4e41-b1fe-e53a554fb94d" by "attach_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:31:26 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-09374c3b-42e1-469f-9907-2425659079df tempest-VolumesActionsTest-1465184981 None] Lock "cinder-73ba3da5-2579-4e41-b1fe-e53a554fb94d" acquired by "attach_volume" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:31:26 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-09374c3b-42e1-469f-9907-2425659079df tempest-VolumesActionsTest-1465184981 None] Attaching volume 73ba3da5-2579-4e41-b1fe-e53a554fb94d to instance 3c82dc7c-ab97-4b1d-8934-cc34f347f4d2 at mountpoint /dev/vdb on host None.
Apr 02 10:31:26 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-09374c3b-42e1-469f-9907-2425659079df tempest-VolumesActionsTest-1465184981 None] Attach volume completed successfully.
Apr 02 10:31:26 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-09374c3b-42e1-469f-9907-2425659079df tempest-VolumesActionsTest-1465184981 None] Lock "cinder-73ba3da5-2579-4e41-b1fe-e53a554fb94d" released by "attach_volume" :: held 0.059s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:31:27 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-59d2a1fe-2427-483d-a18e-df45676c68d3 tempest-VolumesExtendTest-374819619 None] Acquiring lock "cinder-d0f68d3f-0084-4d32-9faa-34b754a2c1d8-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:31:27 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-59d2a1fe-2427-483d-a18e-df45676c68d3 tempest-VolumesExtendTest-374819619 None] Lock "cinder-d0f68d3f-0084-4d32-9faa-34b754a2c1d8-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:31:27 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-59d2a1fe-2427-483d-a18e-df45676c68d3 tempest-VolumesExtendTest-374819619 None] Acquiring lock "cinder-quobyte-d0f68d3f-0084-4d32-9faa-34b754a2c1d8" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:31:27 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-59d2a1fe-2427-483d-a18e-df45676c68d3 tempest-VolumesExtendTest-374819619 None] Lock "cinder-quobyte-d0f68d3f-0084-4d32-9faa-34b754a2c1d8" acquired by "delete_volume" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:31:27 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3feb9a-1e3a-467d-ab21-87562ce0427f]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:31:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-59d2a1fe-2427-483d-a18e-df45676c68d3 tempest-VolumesExtendTest-374819619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:27 devstack sudo[88307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8
Apr 02 10:31:27 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:27 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2b3f35d6-adc0-4f70-94ef-047193c9669d tempest-VolumesActionsTest-1465184981 None] Acquiring lock "cinder-73ba3da5-2579-4e41-b1fe-e53a554fb94d-detach_volume" by "detach_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:31:27 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2b3f35d6-adc0-4f70-94ef-047193c9669d tempest-VolumesActionsTest-1465184981 None] Lock "cinder-73ba3da5-2579-4e41-b1fe-e53a554fb94d-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:31:27 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-2b3f35d6-adc0-4f70-94ef-047193c9669d tempest-VolumesActionsTest-1465184981 None] Detaching volume 73ba3da5-2579-4e41-b1fe-e53a554fb94d from instance 3c82dc7c-ab97-4b1d-8934-cc34f347f4d2.
Apr 02 10:31:27 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-2b3f35d6-adc0-4f70-94ef-047193c9669d tempest-VolumesActionsTest-1465184981 None] Detach volume completed successfully.
Apr 02 10:31:27 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2b3f35d6-adc0-4f70-94ef-047193c9669d tempest-VolumesActionsTest-1465184981 None] Lock "cinder-73ba3da5-2579-4e41-b1fe-e53a554fb94d-detach_volume" released by "detach_volume" :: held 0.039s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:31:27 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-59d2a1fe-2427-483d-a18e-df45676c68d3 tempest-VolumesExtendTest-374819619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8" returned: 0 in 0.482s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-59d2a1fe-2427-483d-a18e-df45676c68d3 tempest-VolumesExtendTest-374819619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:27 devstack sudo[88312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8
Apr 02 10:31:27 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:28 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-59d2a1fe-2427-483d-a18e-df45676c68d3 tempest-VolumesExtendTest-374819619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d0f68d3f-0084-4d32-9faa-34b754a2c1d8" returned: 0 in 0.442s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:28 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-59d2a1fe-2427-483d-a18e-df45676c68d3 tempest-VolumesExtendTest-374819619 None] Lock "cinder-quobyte-d0f68d3f-0084-4d32-9faa-34b754a2c1d8" released by "delete_volume" :: held 0.967s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:31:28 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-59d2a1fe-2427-483d-a18e-df45676c68d3 tempest-VolumesExtendTest-374819619 None] Created reservations ['533fb53c-915d-4428-aeed-4937f5bb4895', '2788b784-9305-4302-901a-2ebc3cc66689', '91c6faf3-5d29-48b1-8f1c-75cf77d3b646', 'd62429a7-89c9-4a09-a0b5-86cae1e80730'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:31:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-59d2a1fe-2427-483d-a18e-df45676c68d3 tempest-VolumesExtendTest-374819619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:31:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-59d2a1fe-2427-483d-a18e-df45676c68d3 tempest-VolumesExtendTest-374819619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:31:28 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-59d2a1fe-2427-483d-a18e-df45676c68d3 tempest-VolumesExtendTest-374819619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:31:28 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-59d2a1fe-2427-483d-a18e-df45676c68d3 tempest-VolumesExtendTest-374819619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:31:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-59d2a1fe-2427-483d-a18e-df45676c68d3 tempest-VolumesExtendTest-374819619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:31:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-59d2a1fe-2427-483d-a18e-df45676c68d3 tempest-VolumesExtendTest-374819619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:28 devstack sudo[88315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:31:28 devstack sudo[88315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:28 devstack sudo[88315]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-59d2a1fe-2427-483d-a18e-df45676c68d3 tempest-VolumesExtendTest-374819619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.528s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:28 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-59d2a1fe-2427-483d-a18e-df45676c68d3 tempest-VolumesExtendTest-374819619 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:31:28 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-59d2a1fe-2427-483d-a18e-df45676c68d3 tempest-VolumesExtendTest-374819619 None] Deleted volume successfully.
Apr 02 10:31:28 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-59d2a1fe-2427-483d-a18e-df45676c68d3 tempest-VolumesExtendTest-374819619 None] Lock "cinder-d0f68d3f-0084-4d32-9faa-34b754a2c1d8-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:31:30 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-db0c0ea2-ebc3-4587-b1e2-0fe4e9a1d00a tempest-VolumesSnapshotListTestJSON-238667818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:31:30 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-db0c0ea2-ebc3-4587-b1e2-0fe4e9a1d00a tempest-VolumesSnapshotListTestJSON-238667818 None] Flow 'volume_create_manager' (78f6d7d4-d6e9-42cf-b856-d81f51469fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:31:30 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-db0c0ea2-ebc3-4587-b1e2-0fe4e9a1d00a tempest-VolumesSnapshotListTestJSON-238667818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (752437c1-e6e4-4922-b674-78e6ab06721d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:31:30 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-db0c0ea2-ebc3-4587-b1e2-0fe4e9a1d00a tempest-VolumesSnapshotListTestJSON-238667818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (752437c1-e6e4-4922-b674-78e6ab06721d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1629565384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=830f0b31-693b-426d-a31d-654c9e7168c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37dabe1aa38a4547a2992b4accdb82d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:31:30Z,use_quota=True,user_id='fd927f9b8da84d8e93dc07beefbee444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:31:30 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-db0c0ea2-ebc3-4587-b1e2-0fe4e9a1d00a tempest-VolumesSnapshotListTestJSON-238667818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7384955b-3beb-4f8c-b197-7b8889d12ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:31:30 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-db0c0ea2-ebc3-4587-b1e2-0fe4e9a1d00a tempest-VolumesSnapshotListTestJSON-238667818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7384955b-3beb-4f8c-b197-7b8889d12ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:31:30 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-db0c0ea2-ebc3-4587-b1e2-0fe4e9a1d00a tempest-VolumesSnapshotListTestJSON-238667818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c7da401-2410-420f-9505-1be3e2cb4085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:31:30 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-db0c0ea2-ebc3-4587-b1e2-0fe4e9a1d00a tempest-VolumesSnapshotListTestJSON-238667818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c7da401-2410-420f-9505-1be3e2cb4085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '830f0b31-693b-426d-a31d-654c9e7168c1', 'volume_name': 'volume-830f0b31-693b-426d-a31d-654c9e7168c1', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:31:30 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-db0c0ea2-ebc3-4587-b1e2-0fe4e9a1d00a tempest-VolumesSnapshotListTestJSON-238667818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (043d8d1f-9742-4a27-ba9a-7494e708eb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:31:30 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-db0c0ea2-ebc3-4587-b1e2-0fe4e9a1d00a tempest-VolumesSnapshotListTestJSON-238667818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (043d8d1f-9742-4a27-ba9a-7494e708eb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:31:30 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-db0c0ea2-ebc3-4587-b1e2-0fe4e9a1d00a tempest-VolumesSnapshotListTestJSON-238667818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ef3de53-df22-44ee-b58e-c3135558f01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:31:30 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-db0c0ea2-ebc3-4587-b1e2-0fe4e9a1d00a tempest-VolumesSnapshotListTestJSON-238667818 None] Volume 830f0b31-693b-426d-a31d-654c9e7168c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-830f0b31-693b-426d-a31d-654c9e7168c1', 'volume_size': 1}
Apr 02 10:31:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-db0c0ea2-ebc3-4587-b1e2-0fe4e9a1d00a tempest-VolumesSnapshotListTestJSON-238667818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:31:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-db0c0ea2-ebc3-4587-b1e2-0fe4e9a1d00a tempest-VolumesSnapshotListTestJSON-238667818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:31:30 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-db0c0ea2-ebc3-4587-b1e2-0fe4e9a1d00a tempest-VolumesSnapshotListTestJSON-238667818 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1629565384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=830f0b31-693b-426d-a31d-654c9e7168c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37dabe1aa38a4547a2992b4accdb82d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:31:30Z,use_quota=True,user_id='fd927f9b8da84d8e93dc07beefbee444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:31:30 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-db0c0ea2-ebc3-4587-b1e2-0fe4e9a1d00a tempest-VolumesSnapshotListTestJSON-238667818 None] Creating volume 830f0b31-693b-426d-a31d-654c9e7168c1 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:31:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-db0c0ea2-ebc3-4587-b1e2-0fe4e9a1d00a tempest-VolumesSnapshotListTestJSON-238667818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:31:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-db0c0ea2-ebc3-4587-b1e2-0fe4e9a1d00a tempest-VolumesSnapshotListTestJSON-238667818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:31:30 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-db0c0ea2-ebc3-4587-b1e2-0fe4e9a1d00a tempest-VolumesSnapshotListTestJSON-238667818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:31:30 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-db0c0ea2-ebc3-4587-b1e2-0fe4e9a1d00a tempest-VolumesSnapshotListTestJSON-238667818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:31:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-db0c0ea2-ebc3-4587-b1e2-0fe4e9a1d00a tempest-VolumesSnapshotListTestJSON-238667818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:31:30 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-db0c0ea2-ebc3-4587-b1e2-0fe4e9a1d00a tempest-VolumesSnapshotListTestJSON-238667818 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:31:30 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-db0c0ea2-ebc3-4587-b1e2-0fe4e9a1d00a tempest-VolumesSnapshotListTestJSON-238667818 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:31:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-db0c0ea2-ebc3-4587-b1e2-0fe4e9a1d00a tempest-VolumesSnapshotListTestJSON-238667818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:30 devstack sudo[88348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1 1073741824
Apr 02 10:31:30 devstack sudo[88348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:30 devstack sudo[88348]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-db0c0ea2-ebc3-4587-b1e2-0fe4e9a1d00a tempest-VolumesSnapshotListTestJSON-238667818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1 1073741824" returned: 0 in 0.479s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-db0c0ea2-ebc3-4587-b1e2-0fe4e9a1d00a tempest-VolumesSnapshotListTestJSON-238667818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:30 devstack sudo[88353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1
Apr 02 10:31:30 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:31 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-db0c0ea2-ebc3-4587-b1e2-0fe4e9a1d00a tempest-VolumesSnapshotListTestJSON-238667818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1" returned: 0 in 0.403s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:31 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-db0c0ea2-ebc3-4587-b1e2-0fe4e9a1d00a tempest-VolumesSnapshotListTestJSON-238667818 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:31:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-db0c0ea2-ebc3-4587-b1e2-0fe4e9a1d00a tempest-VolumesSnapshotListTestJSON-238667818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:31:31 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-db0c0ea2-ebc3-4587-b1e2-0fe4e9a1d00a tempest-VolumesSnapshotListTestJSON-238667818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ef3de53-df22-44ee-b58e-c3135558f01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-830f0b31-693b-426d-a31d-654c9e7168c1', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:31:31 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-db0c0ea2-ebc3-4587-b1e2-0fe4e9a1d00a tempest-VolumesSnapshotListTestJSON-238667818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4465b1d-5ec7-4a1d-a9d0-ebc6b06b90df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:31:31 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-db0c0ea2-ebc3-4587-b1e2-0fe4e9a1d00a tempest-VolumesSnapshotListTestJSON-238667818 None] Volume volume-830f0b31-693b-426d-a31d-654c9e7168c1 (830f0b31-693b-426d-a31d-654c9e7168c1): created successfully
Apr 02 10:31:31 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-db0c0ea2-ebc3-4587-b1e2-0fe4e9a1d00a tempest-VolumesSnapshotListTestJSON-238667818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4465b1d-5ec7-4a1d-a9d0-ebc6b06b90df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:31:31 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-db0c0ea2-ebc3-4587-b1e2-0fe4e9a1d00a tempest-VolumesSnapshotListTestJSON-238667818 None] Flow 'volume_create_manager' (78f6d7d4-d6e9-42cf-b856-d81f51469fa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:31:31 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-db0c0ea2-ebc3-4587-b1e2-0fe4e9a1d00a tempest-VolumesSnapshotListTestJSON-238667818 None] Created volume successfully.
Apr 02 10:31:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-cfd1f8a9-414c-4d4e-9bb8-5ac67f9f88df tempest-VolumesSnapshotListTestJSON-238667818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:31:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-cfd1f8a9-414c-4d4e-9bb8-5ac67f9f88df tempest-VolumesSnapshotListTestJSON-238667818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:31:31 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-cfd1f8a9-414c-4d4e-9bb8-5ac67f9f88df tempest-VolumesSnapshotListTestJSON-238667818 None] Creating offline snapshot e323db39-3651-4f3e-b752-ac787075391c of volume 830f0b31-693b-426d-a31d-654c9e7168c1 {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:31:31 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e298d0d-ea1f-46c7-b496-aed738b05f5a]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:31:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cfd1f8a9-414c-4d4e-9bb8-5ac67f9f88df tempest-VolumesSnapshotListTestJSON-238667818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:31 devstack sudo[88358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1
Apr 02 10:31:31 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:31 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cfd1f8a9-414c-4d4e-9bb8-5ac67f9f88df tempest-VolumesSnapshotListTestJSON-238667818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1" returned: 0 in 0.493s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cfd1f8a9-414c-4d4e-9bb8-5ac67f9f88df tempest-VolumesSnapshotListTestJSON-238667818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.e323db39-3651-4f3e-b752-ac787075391c 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:31 devstack sudo[88363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.e323db39-3651-4f3e-b752-ac787075391c 1G
Apr 02 10:31:31 devstack sudo[88363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:32 devstack sudo[88363]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cfd1f8a9-414c-4d4e-9bb8-5ac67f9f88df tempest-VolumesSnapshotListTestJSON-238667818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.e323db39-3651-4f3e-b752-ac787075391c 1G" returned: 0 in 0.429s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cfd1f8a9-414c-4d4e-9bb8-5ac67f9f88df tempest-VolumesSnapshotListTestJSON-238667818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-830f0b31-693b-426d-a31d-654c9e7168c1 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.e323db39-3651-4f3e-b752-ac787075391c {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:32 devstack sudo[88368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-830f0b31-693b-426d-a31d-654c9e7168c1 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.e323db39-3651-4f3e-b752-ac787075391c
Apr 02 10:31:32 devstack sudo[88368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:32 devstack sudo[88368]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cfd1f8a9-414c-4d4e-9bb8-5ac67f9f88df tempest-VolumesSnapshotListTestJSON-238667818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-830f0b31-693b-426d-a31d-654c9e7168c1 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.e323db39-3651-4f3e-b752-ac787075391c" returned: 0 in 0.398s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:32 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-cfd1f8a9-414c-4d4e-9bb8-5ac67f9f88df tempest-VolumesSnapshotListTestJSON-238667818 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.e323db39-3651-4f3e-b752-ac787075391c is being set with open permissions: ugo+rw
Apr 02 10:31:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cfd1f8a9-414c-4d4e-9bb8-5ac67f9f88df tempest-VolumesSnapshotListTestJSON-238667818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.e323db39-3651-4f3e-b752-ac787075391c {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:32 devstack sudo[88373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.e323db39-3651-4f3e-b752-ac787075391c
Apr 02 10:31:32 devstack sudo[88373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:33 devstack sudo[88373]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cfd1f8a9-414c-4d4e-9bb8-5ac67f9f88df tempest-VolumesSnapshotListTestJSON-238667818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.e323db39-3651-4f3e-b752-ac787075391c" returned: 0 in 0.406s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cfd1f8a9-414c-4d4e-9bb8-5ac67f9f88df tempest-VolumesSnapshotListTestJSON-238667818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:33 devstack sudo[88376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.info
Apr 02 10:31:33 devstack sudo[88376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:33 devstack sudo[88376]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cfd1f8a9-414c-4d4e-9bb8-5ac67f9f88df tempest-VolumesSnapshotListTestJSON-238667818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.info" returned: 0 in 0.400s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:33 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-cfd1f8a9-414c-4d4e-9bb8-5ac67f9f88df tempest-VolumesSnapshotListTestJSON-238667818 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.info is being set with open permissions: ugo+rw
Apr 02 10:31:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cfd1f8a9-414c-4d4e-9bb8-5ac67f9f88df tempest-VolumesSnapshotListTestJSON-238667818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:33 devstack sudo[88379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.info
Apr 02 10:31:33 devstack sudo[88379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:33 devstack sudo[88379]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cfd1f8a9-414c-4d4e-9bb8-5ac67f9f88df tempest-VolumesSnapshotListTestJSON-238667818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.info" returned: 0 in 0.377s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-cfd1f8a9-414c-4d4e-9bb8-5ac67f9f88df tempest-VolumesSnapshotListTestJSON-238667818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.561s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:31:33 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-cfd1f8a9-414c-4d4e-9bb8-5ac67f9f88df tempest-VolumesSnapshotListTestJSON-238667818 None] Create snapshot completed successfully
Apr 02 10:31:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-b84ef66b-3fa7-46fd-94de-dbe7e8887adc tempest-VolumesSnapshotListTestJSON-238667818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:31:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-b84ef66b-3fa7-46fd-94de-dbe7e8887adc tempest-VolumesSnapshotListTestJSON-238667818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:31:34 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-b84ef66b-3fa7-46fd-94de-dbe7e8887adc tempest-VolumesSnapshotListTestJSON-238667818 None] Creating offline snapshot 091926a6-76a0-4f96-828c-be54ae1c0cc5 of volume 830f0b31-693b-426d-a31d-654c9e7168c1 {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:31:34 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef47b6be-3234-4e0f-939a-17e8a7828dae]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:31:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b84ef66b-3fa7-46fd-94de-dbe7e8887adc tempest-VolumesSnapshotListTestJSON-238667818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.e323db39-3651-4f3e-b752-ac787075391c {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:34 devstack sudo[88382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.e323db39-3651-4f3e-b752-ac787075391c
Apr 02 10:31:34 devstack sudo[88382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:35 devstack sudo[88382]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b84ef66b-3fa7-46fd-94de-dbe7e8887adc tempest-VolumesSnapshotListTestJSON-238667818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.e323db39-3651-4f3e-b752-ac787075391c" returned: 0 in 0.531s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:35 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-b84ef66b-3fa7-46fd-94de-dbe7e8887adc tempest-VolumesSnapshotListTestJSON-238667818 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-830f0b31-693b-426d-a31d-654c9e7168c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:31:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b84ef66b-3fa7-46fd-94de-dbe7e8887adc tempest-VolumesSnapshotListTestJSON-238667818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.e323db39-3651-4f3e-b752-ac787075391c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.091926a6-76a0-4f96-828c-be54ae1c0cc5 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:35 devstack sudo[88387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.e323db39-3651-4f3e-b752-ac787075391c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.091926a6-76a0-4f96-828c-be54ae1c0cc5 1G
Apr 02 10:31:35 devstack sudo[88387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5c9fc776-a84f-4c60-80ff-d684b068029e tempest-VolumesActionsTest-1465184981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:31:35 devstack sudo[88387]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b84ef66b-3fa7-46fd-94de-dbe7e8887adc tempest-VolumesSnapshotListTestJSON-238667818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.e323db39-3651-4f3e-b752-ac787075391c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.091926a6-76a0-4f96-828c-be54ae1c0cc5 1G" returned: 0 in 0.503s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b84ef66b-3fa7-46fd-94de-dbe7e8887adc tempest-VolumesSnapshotListTestJSON-238667818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-830f0b31-693b-426d-a31d-654c9e7168c1.e323db39-3651-4f3e-b752-ac787075391c -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.091926a6-76a0-4f96-828c-be54ae1c0cc5 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:35 devstack sudo[88392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-830f0b31-693b-426d-a31d-654c9e7168c1.e323db39-3651-4f3e-b752-ac787075391c -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.091926a6-76a0-4f96-828c-be54ae1c0cc5
Apr 02 10:31:35 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:36 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b84ef66b-3fa7-46fd-94de-dbe7e8887adc tempest-VolumesSnapshotListTestJSON-238667818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-830f0b31-693b-426d-a31d-654c9e7168c1.e323db39-3651-4f3e-b752-ac787075391c -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.091926a6-76a0-4f96-828c-be54ae1c0cc5" returned: 0 in 0.408s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:36 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-b84ef66b-3fa7-46fd-94de-dbe7e8887adc tempest-VolumesSnapshotListTestJSON-238667818 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.091926a6-76a0-4f96-828c-be54ae1c0cc5 is being set with open permissions: ugo+rw
Apr 02 10:31:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b84ef66b-3fa7-46fd-94de-dbe7e8887adc tempest-VolumesSnapshotListTestJSON-238667818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.091926a6-76a0-4f96-828c-be54ae1c0cc5 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:36 devstack sudo[88397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.091926a6-76a0-4f96-828c-be54ae1c0cc5
Apr 02 10:31:36 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:36 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b84ef66b-3fa7-46fd-94de-dbe7e8887adc tempest-VolumesSnapshotListTestJSON-238667818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.091926a6-76a0-4f96-828c-be54ae1c0cc5" returned: 0 in 0.410s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-b84ef66b-3fa7-46fd-94de-dbe7e8887adc tempest-VolumesSnapshotListTestJSON-238667818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.915s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:31:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5c9fc776-a84f-4c60-80ff-d684b068029e tempest-VolumesActionsTest-1465184981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.181s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:31:36 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[060c42e2-8f71-4718-86a5-0b3364de784d]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:31:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5c9fc776-a84f-4c60-80ff-d684b068029e tempest-VolumesActionsTest-1465184981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:36 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-b84ef66b-3fa7-46fd-94de-dbe7e8887adc tempest-VolumesSnapshotListTestJSON-238667818 None] Create snapshot completed successfully
Apr 02 10:31:36 devstack sudo[88400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d
Apr 02 10:31:36 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-2665ca20-077d-4989-8f46-c48c31cd0097 tempest-VolumesSnapshotListTestJSON-238667818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:31:37 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5c9fc776-a84f-4c60-80ff-d684b068029e tempest-VolumesActionsTest-1465184981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d" returned: 0 in 0.522s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:37 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4d767d-dcf2-4f1b-869e-511fbab72e03]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:31:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5c9fc776-a84f-4c60-80ff-d684b068029e tempest-VolumesActionsTest-1465184981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:37 devstack sudo[88405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d
Apr 02 10:31:37 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:37 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5c9fc776-a84f-4c60-80ff-d684b068029e tempest-VolumesActionsTest-1465184981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d" returned: 0 in 0.477s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5c9fc776-a84f-4c60-80ff-d684b068029e tempest-VolumesActionsTest-1465184981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d /opt/stack/data/cinder/conversion/73ba3da5-2579-4e41-b1fe-e53a554fb94d.temp_image.8d1e88cc-bbff-4e5d-b225-ff642ea2c36ed1chlwub.img {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:37 devstack sudo[88410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d /opt/stack/data/cinder/conversion/73ba3da5-2579-4e41-b1fe-e53a554fb94d.temp_image.8d1e88cc-bbff-4e5d-b225-ff642ea2c36ed1chlwub.img
Apr 02 10:31:37 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:39 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5c9fc776-a84f-4c60-80ff-d684b068029e tempest-VolumesActionsTest-1465184981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d /opt/stack/data/cinder/conversion/73ba3da5-2579-4e41-b1fe-e53a554fb94d.temp_image.8d1e88cc-bbff-4e5d-b225-ff642ea2c36ed1chlwub.img" returned: 0 in 2.268s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:39 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[816e5083-f830-413b-9bd8-6cf3453d0e5e]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:31:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5c9fc776-a84f-4c60-80ff-d684b068029e tempest-VolumesActionsTest-1465184981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:39 devstack sudo[88422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d
Apr 02 10:31:39 devstack sudo[88422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:40 devstack sudo[88422]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5c9fc776-a84f-4c60-80ff-d684b068029e tempest-VolumesActionsTest-1465184981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d" returned: 0 in 0.601s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:40 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [None req-5c9fc776-a84f-4c60-80ff-d684b068029e tempest-VolumesActionsTest-1465184981 None] Image conversion details: src /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d, size 1024.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/conversion/73ba3da5-2579-4e41-b1fe-e53a554fb94d.temp_image.8d1e88cc-bbff-4e5d-b225-ff642ea2c36ed1chlwub.img {{(pid=82102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 02 10:31:40 devstack cinder-volume[82102]: INFO cinder.image.image_utils [None req-5c9fc776-a84f-4c60-80ff-d684b068029e tempest-VolumesActionsTest-1465184981 None] Converted 1024.00 MB image at 451.37 MB/s
Apr 02 10:31:40 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [None req-5c9fc776-a84f-4c60-80ff-d684b068029e tempest-VolumesActionsTest-1465184981 None] 8d1e88cc-bbff-4e5d-b225-ff642ea2c36e was raw, no need to convert to raw {{(pid=82102) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 02 10:31:46 devstack cinder-volume[82102]: DEBUG dbcounter [-] [82102] Writing DB stats cinder:UPDATE=78,cinder:SELECT=67,cinder:INSERT=14,cinder:DELETE=3 {{(pid=82102) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 02 10:31:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5c9fc776-a84f-4c60-80ff-d684b068029e tempest-VolumesActionsTest-1465184981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.877s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:31:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5c9fc776-a84f-4c60-80ff-d684b068029e tempest-VolumesActionsTest-1465184981 None] Uploaded volume to glance image-id: 8d1e88cc-bbff-4e5d-b225-ff642ea2c36e. {{(pid=82102) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 02 10:31:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-2665ca20-077d-4989-8f46-c48c31cd0097 tempest-VolumesSnapshotListTestJSON-238667818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.559s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:31:50 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-2665ca20-077d-4989-8f46-c48c31cd0097 tempest-VolumesSnapshotListTestJSON-238667818 None] Creating offline snapshot 8f2f85c7-740d-4b13-99be-8f07b16ea659 of volume 830f0b31-693b-426d-a31d-654c9e7168c1 {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:31:50 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-5c9fc776-a84f-4c60-80ff-d684b068029e tempest-VolumesActionsTest-1465184981 None] Copy volume to image completed successfully.
Apr 02 10:31:50 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2453741-47f8-47e2-b420-dc1fd7ebab10]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:31:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2665ca20-077d-4989-8f46-c48c31cd0097 tempest-VolumesSnapshotListTestJSON-238667818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.091926a6-76a0-4f96-828c-be54ae1c0cc5 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:50 devstack sudo[88468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.091926a6-76a0-4f96-828c-be54ae1c0cc5
Apr 02 10:31:50 devstack sudo[88468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:50 devstack sudo[88468]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2665ca20-077d-4989-8f46-c48c31cd0097 tempest-VolumesSnapshotListTestJSON-238667818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.091926a6-76a0-4f96-828c-be54ae1c0cc5" returned: 0 in 0.473s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:50 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-2665ca20-077d-4989-8f46-c48c31cd0097 tempest-VolumesSnapshotListTestJSON-238667818 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-830f0b31-693b-426d-a31d-654c9e7168c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:31:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2665ca20-077d-4989-8f46-c48c31cd0097 tempest-VolumesSnapshotListTestJSON-238667818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.091926a6-76a0-4f96-828c-be54ae1c0cc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.8f2f85c7-740d-4b13-99be-8f07b16ea659 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:50 devstack sudo[88473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.091926a6-76a0-4f96-828c-be54ae1c0cc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.8f2f85c7-740d-4b13-99be-8f07b16ea659 1G
Apr 02 10:31:50 devstack sudo[88473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:51 devstack sudo[88473]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2665ca20-077d-4989-8f46-c48c31cd0097 tempest-VolumesSnapshotListTestJSON-238667818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.091926a6-76a0-4f96-828c-be54ae1c0cc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.8f2f85c7-740d-4b13-99be-8f07b16ea659 1G" returned: 0 in 0.583s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2665ca20-077d-4989-8f46-c48c31cd0097 tempest-VolumesSnapshotListTestJSON-238667818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-830f0b31-693b-426d-a31d-654c9e7168c1.091926a6-76a0-4f96-828c-be54ae1c0cc5 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.8f2f85c7-740d-4b13-99be-8f07b16ea659 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:51 devstack sudo[88479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-830f0b31-693b-426d-a31d-654c9e7168c1.091926a6-76a0-4f96-828c-be54ae1c0cc5 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.8f2f85c7-740d-4b13-99be-8f07b16ea659
Apr 02 10:31:51 devstack sudo[88479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-66f0fcba-3ce4-4c21-b9ed-c335f03d5a2c tempest-VolumesActionsTest-1465184981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:31:51 devstack sudo[88479]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2665ca20-077d-4989-8f46-c48c31cd0097 tempest-VolumesSnapshotListTestJSON-238667818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-830f0b31-693b-426d-a31d-654c9e7168c1.091926a6-76a0-4f96-828c-be54ae1c0cc5 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.8f2f85c7-740d-4b13-99be-8f07b16ea659" returned: 0 in 0.516s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:51 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-2665ca20-077d-4989-8f46-c48c31cd0097 tempest-VolumesSnapshotListTestJSON-238667818 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.8f2f85c7-740d-4b13-99be-8f07b16ea659 is being set with open permissions: ugo+rw
Apr 02 10:31:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2665ca20-077d-4989-8f46-c48c31cd0097 tempest-VolumesSnapshotListTestJSON-238667818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.8f2f85c7-740d-4b13-99be-8f07b16ea659 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:51 devstack sudo[88484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.8f2f85c7-740d-4b13-99be-8f07b16ea659
Apr 02 10:31:52 devstack sudo[88484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:52 devstack sudo[88484]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2665ca20-077d-4989-8f46-c48c31cd0097 tempest-VolumesSnapshotListTestJSON-238667818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.8f2f85c7-740d-4b13-99be-8f07b16ea659" returned: 0 in 0.437s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-2665ca20-077d-4989-8f46-c48c31cd0097 tempest-VolumesSnapshotListTestJSON-238667818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.072s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:31:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-66f0fcba-3ce4-4c21-b9ed-c335f03d5a2c tempest-VolumesActionsTest-1465184981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.873s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:31:52 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66663c0-2a5b-471e-bf62-1fd155fc09a0]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:31:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-66f0fcba-3ce4-4c21-b9ed-c335f03d5a2c tempest-VolumesActionsTest-1465184981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:52 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-2665ca20-077d-4989-8f46-c48c31cd0097 tempest-VolumesSnapshotListTestJSON-238667818 None] Create snapshot completed successfully
Apr 02 10:31:52 devstack sudo[88487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d
Apr 02 10:31:52 devstack sudo[88487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:52 devstack sudo[88487]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-66f0fcba-3ce4-4c21-b9ed-c335f03d5a2c tempest-VolumesActionsTest-1465184981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d" returned: 0 in 0.467s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:52 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4ed7ed-a6bf-4ada-8c8d-faf448f8b488]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:31:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-66f0fcba-3ce4-4c21-b9ed-c335f03d5a2c tempest-VolumesActionsTest-1465184981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:52 devstack sudo[88492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d
Apr 02 10:31:52 devstack sudo[88492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:53 devstack sudo[88492]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-66f0fcba-3ce4-4c21-b9ed-c335f03d5a2c tempest-VolumesActionsTest-1465184981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d" returned: 0 in 0.494s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-66f0fcba-3ce4-4c21-b9ed-c335f03d5a2c tempest-VolumesActionsTest-1465184981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d /opt/stack/data/cinder/conversion/73ba3da5-2579-4e41-b1fe-e53a554fb94d.temp_image.f81ebfcb-7e7b-4adc-9c89-b3c8b8ffd8022k3_fw5z.img {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:53 devstack sudo[88497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d /opt/stack/data/cinder/conversion/73ba3da5-2579-4e41-b1fe-e53a554fb94d.temp_image.f81ebfcb-7e7b-4adc-9c89-b3c8b8ffd8022k3_fw5z.img
Apr 02 10:31:53 devstack sudo[88497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:54 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-aa098b45-a05b-4f29-a281-27f76c2807ce tempest-VolumesSnapshotListTestJSON-238667818 None] Acquiring lock "cinder-8f2f85c7-740d-4b13-99be-8f07b16ea659-delete_snapshot" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:31:54 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-aa098b45-a05b-4f29-a281-27f76c2807ce tempest-VolumesSnapshotListTestJSON-238667818 None] Lock "cinder-8f2f85c7-740d-4b13-99be-8f07b16ea659-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:31:54 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-aa098b45-a05b-4f29-a281-27f76c2807ce tempest-VolumesSnapshotListTestJSON-238667818 None] Acquiring lock "cinder-quobyte-830f0b31-693b-426d-a31d-654c9e7168c1" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:31:54 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-aa098b45-a05b-4f29-a281-27f76c2807ce tempest-VolumesSnapshotListTestJSON-238667818 None] Lock "cinder-quobyte-830f0b31-693b-426d-a31d-654c9e7168c1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:31:54 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-aa098b45-a05b-4f29-a281-27f76c2807ce tempest-VolumesSnapshotListTestJSON-238667818 None] Acquiring lock "cinder-quobyte-8f2f85c7-740d-4b13-99be-8f07b16ea659" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:31:55 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-aa098b45-a05b-4f29-a281-27f76c2807ce tempest-VolumesSnapshotListTestJSON-238667818 None] Lock "cinder-quobyte-8f2f85c7-740d-4b13-99be-8f07b16ea659" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:31:55 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-aa098b45-a05b-4f29-a281-27f76c2807ce tempest-VolumesSnapshotListTestJSON-238667818 None] Deleting offline snapshot 8f2f85c7-740d-4b13-99be-8f07b16ea659 of volume 830f0b31-693b-426d-a31d-654c9e7168c1 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:31:55 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-aa098b45-a05b-4f29-a281-27f76c2807ce tempest-VolumesSnapshotListTestJSON-238667818 None] snapshot_file for this snap is: volume-830f0b31-693b-426d-a31d-654c9e7168c1.8f2f85c7-740d-4b13-99be-8f07b16ea659 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:31:55 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aee8342-04ed-40c6-b7c7-d72f35a1242d]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:31:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-aa098b45-a05b-4f29-a281-27f76c2807ce tempest-VolumesSnapshotListTestJSON-238667818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.8f2f85c7-740d-4b13-99be-8f07b16ea659 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:55 devstack sudo[88509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.8f2f85c7-740d-4b13-99be-8f07b16ea659
Apr 02 10:31:55 devstack sudo[88509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:55 devstack sudo[88497]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-66f0fcba-3ce4-4c21-b9ed-c335f03d5a2c tempest-VolumesActionsTest-1465184981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d /opt/stack/data/cinder/conversion/73ba3da5-2579-4e41-b1fe-e53a554fb94d.temp_image.f81ebfcb-7e7b-4adc-9c89-b3c8b8ffd8022k3_fw5z.img" returned: 0 in 2.017s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:55 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[488fff81-11fd-4fab-a2e5-0c3f034d0559]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:31:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-66f0fcba-3ce4-4c21-b9ed-c335f03d5a2c tempest-VolumesActionsTest-1465184981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:55 devstack sudo[88511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d
Apr 02 10:31:55 devstack sudo[88511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:55 devstack sudo[88509]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-aa098b45-a05b-4f29-a281-27f76c2807ce tempest-VolumesSnapshotListTestJSON-238667818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.8f2f85c7-740d-4b13-99be-8f07b16ea659" returned: 0 in 0.645s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:55 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-aa098b45-a05b-4f29-a281-27f76c2807ce tempest-VolumesSnapshotListTestJSON-238667818 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-830f0b31-693b-426d-a31d-654c9e7168c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:31:55 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6906e3c7-73bd-40a4-8cc6-7df2c6f55744]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:31:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-aa098b45-a05b-4f29-a281-27f76c2807ce tempest-VolumesSnapshotListTestJSON-238667818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.091926a6-76a0-4f96-828c-be54ae1c0cc5 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:55 devstack sudo[88516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.091926a6-76a0-4f96-828c-be54ae1c0cc5
Apr 02 10:31:55 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:56 devstack sudo[88511]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-66f0fcba-3ce4-4c21-b9ed-c335f03d5a2c tempest-VolumesActionsTest-1465184981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d" returned: 0 in 0.578s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:56 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [None req-66f0fcba-3ce4-4c21-b9ed-c335f03d5a2c tempest-VolumesActionsTest-1465184981 None] Image conversion details: src /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d, size 1024.00 MB, duration 2.02 sec, destination /opt/stack/data/cinder/conversion/73ba3da5-2579-4e41-b1fe-e53a554fb94d.temp_image.f81ebfcb-7e7b-4adc-9c89-b3c8b8ffd8022k3_fw5z.img {{(pid=82102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 02 10:31:56 devstack cinder-volume[82102]: INFO cinder.image.image_utils [None req-66f0fcba-3ce4-4c21-b9ed-c335f03d5a2c tempest-VolumesActionsTest-1465184981 None] Converted 1024.00 MB image at 507.32 MB/s
Apr 02 10:31:56 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [None req-66f0fcba-3ce4-4c21-b9ed-c335f03d5a2c tempest-VolumesActionsTest-1465184981 None] f81ebfcb-7e7b-4adc-9c89-b3c8b8ffd802 was raw, converting to qcow2 {{(pid=82102) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 02 10:31:56 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3c5a09-2c74-4cea-8685-f1345d69d188]: (4, 'raw') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:31:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-66f0fcba-3ce4-4c21-b9ed-c335f03d5a2c tempest-VolumesActionsTest-1465184981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/73ba3da5-2579-4e41-b1fe-e53a554fb94d.temp_image.f81ebfcb-7e7b-4adc-9c89-b3c8b8ffd8022k3_fw5z.img {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:56 devstack sudo[88521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/73ba3da5-2579-4e41-b1fe-e53a554fb94d.temp_image.f81ebfcb-7e7b-4adc-9c89-b3c8b8ffd8022k3_fw5z.img
Apr 02 10:31:56 devstack sudo[88521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:56 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-aa098b45-a05b-4f29-a281-27f76c2807ce tempest-VolumesSnapshotListTestJSON-238667818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.091926a6-76a0-4f96-828c-be54ae1c0cc5" returned: 0 in 0.462s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:56 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-aa098b45-a05b-4f29-a281-27f76c2807ce tempest-VolumesSnapshotListTestJSON-238667818 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-830f0b31-693b-426d-a31d-654c9e7168c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:31:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-aa098b45-a05b-4f29-a281-27f76c2807ce tempest-VolumesSnapshotListTestJSON-238667818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.8f2f85c7-740d-4b13-99be-8f07b16ea659 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:56 devstack sudo[88526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.8f2f85c7-740d-4b13-99be-8f07b16ea659
Apr 02 10:31:56 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:56 devstack sudo[88521]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-66f0fcba-3ce4-4c21-b9ed-c335f03d5a2c tempest-VolumesActionsTest-1465184981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/73ba3da5-2579-4e41-b1fe-e53a554fb94d.temp_image.f81ebfcb-7e7b-4adc-9c89-b3c8b8ffd8022k3_fw5z.img" returned: 0 in 0.465s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-66f0fcba-3ce4-4c21-b9ed-c335f03d5a2c tempest-VolumesActionsTest-1465184981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/73ba3da5-2579-4e41-b1fe-e53a554fb94d.temp_image.f81ebfcb-7e7b-4adc-9c89-b3c8b8ffd8022k3_fw5z.img {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:56 devstack sudo[88532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/73ba3da5-2579-4e41-b1fe-e53a554fb94d.temp_image.f81ebfcb-7e7b-4adc-9c89-b3c8b8ffd8022k3_fw5z.img
Apr 02 10:31:56 devstack sudo[88532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:56 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-aa098b45-a05b-4f29-a281-27f76c2807ce tempest-VolumesSnapshotListTestJSON-238667818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.8f2f85c7-740d-4b13-99be-8f07b16ea659" returned: 0 in 0.495s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-aa098b45-a05b-4f29-a281-27f76c2807ce tempest-VolumesSnapshotListTestJSON-238667818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.8f2f85c7-740d-4b13-99be-8f07b16ea659 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:56 devstack sudo[88535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.8f2f85c7-740d-4b13-99be-8f07b16ea659
Apr 02 10:31:56 devstack sudo[88535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:57 devstack sudo[88532]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-66f0fcba-3ce4-4c21-b9ed-c335f03d5a2c tempest-VolumesActionsTest-1465184981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/73ba3da5-2579-4e41-b1fe-e53a554fb94d.temp_image.f81ebfcb-7e7b-4adc-9c89-b3c8b8ffd8022k3_fw5z.img" returned: 1 in 0.496s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-66f0fcba-3ce4-4c21-b9ed-c335f03d5a2c tempest-VolumesActionsTest-1465184981 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/73ba3da5-2579-4e41-b1fe-e53a554fb94d.temp_image.f81ebfcb-7e7b-4adc-9c89-b3c8b8ffd8022k3_fw5z.img' failed. Not Retrying. {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 02 10:31:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-66f0fcba-3ce4-4c21-b9ed-c335f03d5a2c tempest-VolumesActionsTest-1465184981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/73ba3da5-2579-4e41-b1fe-e53a554fb94d.temp_image.f81ebfcb-7e7b-4adc-9c89-b3c8b8ffd8022k3_fw5z.img /opt/stack/data/cinder/conversion/vol_upload_wdrwomms {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:57 devstack sudo[88541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/73ba3da5-2579-4e41-b1fe-e53a554fb94d.temp_image.f81ebfcb-7e7b-4adc-9c89-b3c8b8ffd8022k3_fw5z.img /opt/stack/data/cinder/conversion/vol_upload_wdrwomms
Apr 02 10:31:57 devstack sudo[88541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:57 devstack sudo[88535]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-aa098b45-a05b-4f29-a281-27f76c2807ce tempest-VolumesSnapshotListTestJSON-238667818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.8f2f85c7-740d-4b13-99be-8f07b16ea659" returned: 0 in 0.435s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:57 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-aa098b45-a05b-4f29-a281-27f76c2807ce tempest-VolumesSnapshotListTestJSON-238667818 None] Lock "cinder-quobyte-8f2f85c7-740d-4b13-99be-8f07b16ea659" released by "_delete_snapshot" :: held 2.111s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:31:57 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-aa098b45-a05b-4f29-a281-27f76c2807ce tempest-VolumesSnapshotListTestJSON-238667818 None] Lock "cinder-quobyte-830f0b31-693b-426d-a31d-654c9e7168c1" released by "delete_snapshot" :: held 2.138s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:31:57 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-aa098b45-a05b-4f29-a281-27f76c2807ce tempest-VolumesSnapshotListTestJSON-238667818 None] Created reservations ['f9f4e96c-001e-43ba-b194-d420821dea57', 'f9e2834e-acf2-4282-a820-0b2557bc5db6', '3fee979c-17cd-4171-b04b-cd8829eef68a', '559eb623-8811-40ac-97aa-9db8f65c3319'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:31:57 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-aa098b45-a05b-4f29-a281-27f76c2807ce tempest-VolumesSnapshotListTestJSON-238667818 None] Delete snapshot completed successfully.
Apr 02 10:31:57 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-aa098b45-a05b-4f29-a281-27f76c2807ce tempest-VolumesSnapshotListTestJSON-238667818 None] Lock "cinder-8f2f85c7-740d-4b13-99be-8f07b16ea659-delete_snapshot" released by "delete_snapshot" :: held 2.264s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:31:57 devstack sudo[88541]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-66f0fcba-3ce4-4c21-b9ed-c335f03d5a2c tempest-VolumesActionsTest-1465184981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/73ba3da5-2579-4e41-b1fe-e53a554fb94d.temp_image.f81ebfcb-7e7b-4adc-9c89-b3c8b8ffd8022k3_fw5z.img /opt/stack/data/cinder/conversion/vol_upload_wdrwomms" returned: 0 in 0.415s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:57 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [None req-66f0fcba-3ce4-4c21-b9ed-c335f03d5a2c tempest-VolumesActionsTest-1465184981 None] Image conversion details: src /opt/stack/data/cinder/conversion/73ba3da5-2579-4e41-b1fe-e53a554fb94d.temp_image.f81ebfcb-7e7b-4adc-9c89-b3c8b8ffd8022k3_fw5z.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_wdrwomms {{(pid=82102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 02 10:31:57 devstack cinder-volume[82102]: INFO cinder.image.image_utils [None req-66f0fcba-3ce4-4c21-b9ed-c335f03d5a2c tempest-VolumesActionsTest-1465184981 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 02 10:31:57 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8d53d8-af4d-425d-adc9-efb8e07d13bf]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:31:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-66f0fcba-3ce4-4c21-b9ed-c335f03d5a2c tempest-VolumesActionsTest-1465184981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_wdrwomms {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:57 devstack sudo[88546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_wdrwomms
Apr 02 10:31:57 devstack sudo[88546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:57 devstack sudo[88546]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-66f0fcba-3ce4-4c21-b9ed-c335f03d5a2c tempest-VolumesActionsTest-1465184981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_wdrwomms" returned: 0 in 0.448s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:58 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-dde812f4-d0a3-4515-9be2-e9ac0ad93eb7 tempest-VolumesSnapshotListTestJSON-238667818 None] Acquiring lock "cinder-091926a6-76a0-4f96-828c-be54ae1c0cc5-delete_snapshot" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:31:58 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-dde812f4-d0a3-4515-9be2-e9ac0ad93eb7 tempest-VolumesSnapshotListTestJSON-238667818 None] Lock "cinder-091926a6-76a0-4f96-828c-be54ae1c0cc5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:31:58 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-dde812f4-d0a3-4515-9be2-e9ac0ad93eb7 tempest-VolumesSnapshotListTestJSON-238667818 None] Acquiring lock "cinder-quobyte-830f0b31-693b-426d-a31d-654c9e7168c1" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:31:58 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-dde812f4-d0a3-4515-9be2-e9ac0ad93eb7 tempest-VolumesSnapshotListTestJSON-238667818 None] Lock "cinder-quobyte-830f0b31-693b-426d-a31d-654c9e7168c1" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:31:58 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-dde812f4-d0a3-4515-9be2-e9ac0ad93eb7 tempest-VolumesSnapshotListTestJSON-238667818 None] Acquiring lock "cinder-quobyte-091926a6-76a0-4f96-828c-be54ae1c0cc5" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:31:58 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-dde812f4-d0a3-4515-9be2-e9ac0ad93eb7 tempest-VolumesSnapshotListTestJSON-238667818 None] Lock "cinder-quobyte-091926a6-76a0-4f96-828c-be54ae1c0cc5" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:31:58 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-dde812f4-d0a3-4515-9be2-e9ac0ad93eb7 tempest-VolumesSnapshotListTestJSON-238667818 None] Deleting offline snapshot 091926a6-76a0-4f96-828c-be54ae1c0cc5 of volume 830f0b31-693b-426d-a31d-654c9e7168c1 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:31:58 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-dde812f4-d0a3-4515-9be2-e9ac0ad93eb7 tempest-VolumesSnapshotListTestJSON-238667818 None] snapshot_file for this snap is: volume-830f0b31-693b-426d-a31d-654c9e7168c1.091926a6-76a0-4f96-828c-be54ae1c0cc5 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:31:58 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f495db-5d8e-4138-8a15-5ca5234060a0]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:31:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-dde812f4-d0a3-4515-9be2-e9ac0ad93eb7 tempest-VolumesSnapshotListTestJSON-238667818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.091926a6-76a0-4f96-828c-be54ae1c0cc5 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:58 devstack sudo[88551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.091926a6-76a0-4f96-828c-be54ae1c0cc5
Apr 02 10:31:58 devstack sudo[88551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:58 devstack sudo[88551]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-dde812f4-d0a3-4515-9be2-e9ac0ad93eb7 tempest-VolumesSnapshotListTestJSON-238667818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.091926a6-76a0-4f96-828c-be54ae1c0cc5" returned: 0 in 0.482s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:58 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-dde812f4-d0a3-4515-9be2-e9ac0ad93eb7 tempest-VolumesSnapshotListTestJSON-238667818 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-830f0b31-693b-426d-a31d-654c9e7168c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:31:58 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ead0ee-3dda-456c-a7cf-636604519e87]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:31:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-dde812f4-d0a3-4515-9be2-e9ac0ad93eb7 tempest-VolumesSnapshotListTestJSON-238667818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.e323db39-3651-4f3e-b752-ac787075391c {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:58 devstack sudo[88556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.e323db39-3651-4f3e-b752-ac787075391c
Apr 02 10:31:58 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-66f0fcba-3ce4-4c21-b9ed-c335f03d5a2c tempest-VolumesActionsTest-1465184981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.436s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:31:58 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-66f0fcba-3ce4-4c21-b9ed-c335f03d5a2c tempest-VolumesActionsTest-1465184981 None] Uploaded volume to glance image-id: f81ebfcb-7e7b-4adc-9c89-b3c8b8ffd802. {{(pid=82102) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 02 10:31:58 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-66f0fcba-3ce4-4c21-b9ed-c335f03d5a2c tempest-VolumesActionsTest-1465184981 None] Copy volume to image completed successfully.
Apr 02 10:31:59 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-dde812f4-d0a3-4515-9be2-e9ac0ad93eb7 tempest-VolumesSnapshotListTestJSON-238667818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.e323db39-3651-4f3e-b752-ac787075391c" returned: 0 in 0.507s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:59 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-dde812f4-d0a3-4515-9be2-e9ac0ad93eb7 tempest-VolumesSnapshotListTestJSON-238667818 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-830f0b31-693b-426d-a31d-654c9e7168c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:31:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-dde812f4-d0a3-4515-9be2-e9ac0ad93eb7 tempest-VolumesSnapshotListTestJSON-238667818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.091926a6-76a0-4f96-828c-be54ae1c0cc5 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:59 devstack sudo[88561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.091926a6-76a0-4f96-828c-be54ae1c0cc5
Apr 02 10:31:59 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:31:59 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root
Apr 02 10:31:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-dde812f4-d0a3-4515-9be2-e9ac0ad93eb7 tempest-VolumesSnapshotListTestJSON-238667818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.091926a6-76a0-4f96-828c-be54ae1c0cc5" returned: 0 in 0.467s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:31:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-dde812f4-d0a3-4515-9be2-e9ac0ad93eb7 tempest-VolumesSnapshotListTestJSON-238667818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.091926a6-76a0-4f96-828c-be54ae1c0cc5 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:31:59 devstack sudo[88566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.091926a6-76a0-4f96-828c-be54ae1c0cc5
Apr 02 10:31:59 devstack sudo[88566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:00 devstack sudo[88566]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-dde812f4-d0a3-4515-9be2-e9ac0ad93eb7 tempest-VolumesSnapshotListTestJSON-238667818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.091926a6-76a0-4f96-828c-be54ae1c0cc5" returned: 0 in 0.442s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:00 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-dde812f4-d0a3-4515-9be2-e9ac0ad93eb7 tempest-VolumesSnapshotListTestJSON-238667818 None] Lock "cinder-quobyte-091926a6-76a0-4f96-828c-be54ae1c0cc5" released by "_delete_snapshot" :: held 1.952s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:00 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-dde812f4-d0a3-4515-9be2-e9ac0ad93eb7 tempest-VolumesSnapshotListTestJSON-238667818 None] Lock "cinder-quobyte-830f0b31-693b-426d-a31d-654c9e7168c1" released by "delete_snapshot" :: held 1.967s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:00 devstack cinder-volume[82102]: DEBUG dbcounter [-] [82102] Writing DB stats cinder:UPDATE=57,cinder:INSERT=29,cinder:DELETE=8,cinder:SELECT=79 {{(pid=82102) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 02 10:32:00 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-dde812f4-d0a3-4515-9be2-e9ac0ad93eb7 tempest-VolumesSnapshotListTestJSON-238667818 None] Created reservations ['decc27ab-489e-4fcb-84e8-51a7126a7afc', 'fa554aab-d5a4-45cb-98aa-4cbf99cdb5a8', '92f6f518-9acd-4268-aa30-548b75ee0677', '675d8264-8e95-49f9-9c88-e8288f322496'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:32:00 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-dde812f4-d0a3-4515-9be2-e9ac0ad93eb7 tempest-VolumesSnapshotListTestJSON-238667818 None] Delete snapshot completed successfully.
Apr 02 10:32:00 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-dde812f4-d0a3-4515-9be2-e9ac0ad93eb7 tempest-VolumesSnapshotListTestJSON-238667818 None] Lock "cinder-091926a6-76a0-4f96-828c-be54ae1c0cc5-delete_snapshot" released by "delete_snapshot" :: held 2.097s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:00 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-77e22ce8-4c10-4a34-9f5c-881c8e49c453 tempest-VolumesActionsTest-1465184981 None] Acquiring lock "cinder-73ba3da5-2579-4e41-b1fe-e53a554fb94d-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:00 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-77e22ce8-4c10-4a34-9f5c-881c8e49c453 tempest-VolumesActionsTest-1465184981 None] Lock "cinder-73ba3da5-2579-4e41-b1fe-e53a554fb94d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:00 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-77e22ce8-4c10-4a34-9f5c-881c8e49c453 tempest-VolumesActionsTest-1465184981 None] Acquiring lock "cinder-quobyte-73ba3da5-2579-4e41-b1fe-e53a554fb94d" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:00 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-77e22ce8-4c10-4a34-9f5c-881c8e49c453 tempest-VolumesActionsTest-1465184981 None] Lock "cinder-quobyte-73ba3da5-2579-4e41-b1fe-e53a554fb94d" acquired by "delete_volume" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:00 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea695f5-2695-49fd-98f4-8ef2d549ad8c]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:32:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-77e22ce8-4c10-4a34-9f5c-881c8e49c453 tempest-VolumesActionsTest-1465184981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:00 devstack sudo[88569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d
Apr 02 10:32:00 devstack sudo[88569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:00 devstack sudo[88569]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-77e22ce8-4c10-4a34-9f5c-881c8e49c453 tempest-VolumesActionsTest-1465184981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d" returned: 0 in 0.490s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-77e22ce8-4c10-4a34-9f5c-881c8e49c453 tempest-VolumesActionsTest-1465184981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:00 devstack sudo[88574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d
Apr 02 10:32:00 devstack sudo[88574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:01 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2714b1d9-87ec-4463-ae6c-feb298193dce tempest-VolumesSnapshotListTestJSON-238667818 None] Acquiring lock "cinder-e323db39-3651-4f3e-b752-ac787075391c-delete_snapshot" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:01 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2714b1d9-87ec-4463-ae6c-feb298193dce tempest-VolumesSnapshotListTestJSON-238667818 None] Lock "cinder-e323db39-3651-4f3e-b752-ac787075391c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:01 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2714b1d9-87ec-4463-ae6c-feb298193dce tempest-VolumesSnapshotListTestJSON-238667818 None] Acquiring lock "cinder-quobyte-830f0b31-693b-426d-a31d-654c9e7168c1" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:01 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2714b1d9-87ec-4463-ae6c-feb298193dce tempest-VolumesSnapshotListTestJSON-238667818 None] Lock "cinder-quobyte-830f0b31-693b-426d-a31d-654c9e7168c1" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:01 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2714b1d9-87ec-4463-ae6c-feb298193dce tempest-VolumesSnapshotListTestJSON-238667818 None] Acquiring lock "cinder-quobyte-e323db39-3651-4f3e-b752-ac787075391c" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:01 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2714b1d9-87ec-4463-ae6c-feb298193dce tempest-VolumesSnapshotListTestJSON-238667818 None] Lock "cinder-quobyte-e323db39-3651-4f3e-b752-ac787075391c" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:01 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-2714b1d9-87ec-4463-ae6c-feb298193dce tempest-VolumesSnapshotListTestJSON-238667818 None] Deleting offline snapshot e323db39-3651-4f3e-b752-ac787075391c of volume 830f0b31-693b-426d-a31d-654c9e7168c1 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:32:01 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-2714b1d9-87ec-4463-ae6c-feb298193dce tempest-VolumesSnapshotListTestJSON-238667818 None] snapshot_file for this snap is: volume-830f0b31-693b-426d-a31d-654c9e7168c1.e323db39-3651-4f3e-b752-ac787075391c {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:32:01 devstack sudo[88574]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-77e22ce8-4c10-4a34-9f5c-881c8e49c453 tempest-VolumesActionsTest-1465184981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-73ba3da5-2579-4e41-b1fe-e53a554fb94d" returned: 0 in 0.420s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:01 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f25bbd-d764-4834-aa39-fa0dea5b4047]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:32:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2714b1d9-87ec-4463-ae6c-feb298193dce tempest-VolumesSnapshotListTestJSON-238667818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.e323db39-3651-4f3e-b752-ac787075391c {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:01 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-77e22ce8-4c10-4a34-9f5c-881c8e49c453 tempest-VolumesActionsTest-1465184981 None] Lock "cinder-quobyte-73ba3da5-2579-4e41-b1fe-e53a554fb94d" released by "delete_volume" :: held 0.943s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:01 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-77e22ce8-4c10-4a34-9f5c-881c8e49c453 tempest-VolumesActionsTest-1465184981 None] Created reservations ['a85dbd65-0833-4f3b-80fb-82efd8ad5bce', '4c047444-d0e8-4a12-880d-528e271e7965', '7b14949e-1952-43d7-9aa5-500c0ce3bce7', 'd9fd4575-3038-4330-8790-1f013376534c'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:32:01 devstack sudo[88578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.e323db39-3651-4f3e-b752-ac787075391c
Apr 02 10:32:01 devstack sudo[88578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-77e22ce8-4c10-4a34-9f5c-881c8e49c453 tempest-VolumesActionsTest-1465184981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-77e22ce8-4c10-4a34-9f5c-881c8e49c453 tempest-VolumesActionsTest-1465184981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:01 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-77e22ce8-4c10-4a34-9f5c-881c8e49c453 tempest-VolumesActionsTest-1465184981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:32:01 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-77e22ce8-4c10-4a34-9f5c-881c8e49c453 tempest-VolumesActionsTest-1465184981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:32:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-77e22ce8-4c10-4a34-9f5c-881c8e49c453 tempest-VolumesActionsTest-1465184981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-77e22ce8-4c10-4a34-9f5c-881c8e49c453 tempest-VolumesActionsTest-1465184981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:01 devstack sudo[88580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:32:01 devstack sudo[88580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:01 devstack sudo[88580]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-77e22ce8-4c10-4a34-9f5c-881c8e49c453 tempest-VolumesActionsTest-1465184981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.453s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:01 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-77e22ce8-4c10-4a34-9f5c-881c8e49c453 tempest-VolumesActionsTest-1465184981 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:32:01 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-77e22ce8-4c10-4a34-9f5c-881c8e49c453 tempest-VolumesActionsTest-1465184981 None] Deleted volume successfully.
Apr 02 10:32:01 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-77e22ce8-4c10-4a34-9f5c-881c8e49c453 tempest-VolumesActionsTest-1465184981 None] Lock "cinder-73ba3da5-2579-4e41-b1fe-e53a554fb94d-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:01 devstack sudo[88578]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2714b1d9-87ec-4463-ae6c-feb298193dce tempest-VolumesSnapshotListTestJSON-238667818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.e323db39-3651-4f3e-b752-ac787075391c" returned: 0 in 0.599s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:01 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-2714b1d9-87ec-4463-ae6c-feb298193dce tempest-VolumesSnapshotListTestJSON-238667818 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-830f0b31-693b-426d-a31d-654c9e7168c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:32:01 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2838821b-b586-49e7-90f8-fd315ff37b39]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:32:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2714b1d9-87ec-4463-ae6c-feb298193dce tempest-VolumesSnapshotListTestJSON-238667818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:01 devstack sudo[88586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1
Apr 02 10:32:01 devstack sudo[88586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:02 devstack sudo[88586]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2714b1d9-87ec-4463-ae6c-feb298193dce tempest-VolumesSnapshotListTestJSON-238667818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1" returned: 0 in 0.589s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2714b1d9-87ec-4463-ae6c-feb298193dce tempest-VolumesSnapshotListTestJSON-238667818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.e323db39-3651-4f3e-b752-ac787075391c {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:02 devstack sudo[88591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.e323db39-3651-4f3e-b752-ac787075391c
Apr 02 10:32:02 devstack sudo[88591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:02 devstack sudo[88591]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2714b1d9-87ec-4463-ae6c-feb298193dce tempest-VolumesSnapshotListTestJSON-238667818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.e323db39-3651-4f3e-b752-ac787075391c" returned: 0 in 0.474s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2714b1d9-87ec-4463-ae6c-feb298193dce tempest-VolumesSnapshotListTestJSON-238667818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.e323db39-3651-4f3e-b752-ac787075391c {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:02 devstack sudo[88597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.e323db39-3651-4f3e-b752-ac787075391c
Apr 02 10:32:02 devstack sudo[88597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:03 devstack sudo[88597]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2714b1d9-87ec-4463-ae6c-feb298193dce tempest-VolumesSnapshotListTestJSON-238667818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1.e323db39-3651-4f3e-b752-ac787075391c" returned: 0 in 0.470s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:03 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2714b1d9-87ec-4463-ae6c-feb298193dce tempest-VolumesSnapshotListTestJSON-238667818 None] Lock "cinder-quobyte-e323db39-3651-4f3e-b752-ac787075391c" released by "_delete_snapshot" :: held 2.212s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:03 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2714b1d9-87ec-4463-ae6c-feb298193dce tempest-VolumesSnapshotListTestJSON-238667818 None] Lock "cinder-quobyte-830f0b31-693b-426d-a31d-654c9e7168c1" released by "delete_snapshot" :: held 2.226s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:03 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-2714b1d9-87ec-4463-ae6c-feb298193dce tempest-VolumesSnapshotListTestJSON-238667818 None] Created reservations ['9ab69945-788d-4e4d-97df-bf98aeff7248', '60cbc518-749f-441b-86d5-718044ec96d3', 'a2923234-6827-40a2-9834-28851f5fbdc7', '9ec12125-3e47-47a2-ab4d-198e7ed3fad8'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:32:03 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-2714b1d9-87ec-4463-ae6c-feb298193dce tempest-VolumesSnapshotListTestJSON-238667818 None] Delete snapshot completed successfully.
Apr 02 10:32:03 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2714b1d9-87ec-4463-ae6c-feb298193dce tempest-VolumesSnapshotListTestJSON-238667818 None] Lock "cinder-e323db39-3651-4f3e-b752-ac787075391c-delete_snapshot" released by "delete_snapshot" :: held 2.334s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:04 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-4de4c487-a952-4a43-8d3d-59352f781803 tempest-VolumesSnapshotListTestJSON-238667818 None] Acquiring lock "cinder-830f0b31-693b-426d-a31d-654c9e7168c1-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:04 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-4de4c487-a952-4a43-8d3d-59352f781803 tempest-VolumesSnapshotListTestJSON-238667818 None] Lock "cinder-830f0b31-693b-426d-a31d-654c9e7168c1-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:04 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-4de4c487-a952-4a43-8d3d-59352f781803 tempest-VolumesSnapshotListTestJSON-238667818 None] Acquiring lock "cinder-quobyte-830f0b31-693b-426d-a31d-654c9e7168c1" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:04 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-4de4c487-a952-4a43-8d3d-59352f781803 tempest-VolumesSnapshotListTestJSON-238667818 None] Lock "cinder-quobyte-830f0b31-693b-426d-a31d-654c9e7168c1" acquired by "delete_volume" :: waited 0.007s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:04 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[841a23bd-794d-4815-875d-913d75e62d50]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:32:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4de4c487-a952-4a43-8d3d-59352f781803 tempest-VolumesSnapshotListTestJSON-238667818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:04 devstack sudo[88600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1
Apr 02 10:32:04 devstack sudo[88600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:05 devstack sudo[88600]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4de4c487-a952-4a43-8d3d-59352f781803 tempest-VolumesSnapshotListTestJSON-238667818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1" returned: 0 in 0.561s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4de4c487-a952-4a43-8d3d-59352f781803 tempest-VolumesSnapshotListTestJSON-238667818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:05 devstack sudo[88606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1
Apr 02 10:32:05 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:05 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4de4c487-a952-4a43-8d3d-59352f781803 tempest-VolumesSnapshotListTestJSON-238667818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-830f0b31-693b-426d-a31d-654c9e7168c1" returned: 0 in 0.471s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:05 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-4de4c487-a952-4a43-8d3d-59352f781803 tempest-VolumesSnapshotListTestJSON-238667818 None] Lock "cinder-quobyte-830f0b31-693b-426d-a31d-654c9e7168c1" released by "delete_volume" :: held 1.085s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:05 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-4de4c487-a952-4a43-8d3d-59352f781803 tempest-VolumesSnapshotListTestJSON-238667818 None] Created reservations ['be499147-0615-4a5a-913f-e68e17eb1753', 'fa314672-f6ee-4954-be2b-4d074e595dea', 'bc3af6c7-7bcc-4ae8-8aef-2975a853504a', '4aa69ff5-79af-4960-989c-f9cd94bb966d'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:32:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-4de4c487-a952-4a43-8d3d-59352f781803 tempest-VolumesSnapshotListTestJSON-238667818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-4de4c487-a952-4a43-8d3d-59352f781803 tempest-VolumesSnapshotListTestJSON-238667818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:05 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-4de4c487-a952-4a43-8d3d-59352f781803 tempest-VolumesSnapshotListTestJSON-238667818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:32:05 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-4de4c487-a952-4a43-8d3d-59352f781803 tempest-VolumesSnapshotListTestJSON-238667818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:32:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-4de4c487-a952-4a43-8d3d-59352f781803 tempest-VolumesSnapshotListTestJSON-238667818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4de4c487-a952-4a43-8d3d-59352f781803 tempest-VolumesSnapshotListTestJSON-238667818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:05 devstack sudo[88609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:32:05 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:06 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4de4c487-a952-4a43-8d3d-59352f781803 tempest-VolumesSnapshotListTestJSON-238667818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.479s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:06 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-4de4c487-a952-4a43-8d3d-59352f781803 tempest-VolumesSnapshotListTestJSON-238667818 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:32:06 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-4de4c487-a952-4a43-8d3d-59352f781803 tempest-VolumesSnapshotListTestJSON-238667818 None] Deleted volume successfully.
Apr 02 10:32:06 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-681dddcb-63e8-4338-92ab-2fd6f6e0c832 tempest-VolumesGetTest-761816182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:32:06 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-681dddcb-63e8-4338-92ab-2fd6f6e0c832 tempest-VolumesGetTest-761816182 None] Flow 'volume_create_manager' (348c73f3-0ed8-4d72-b252-adc623362ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:32:06 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-681dddcb-63e8-4338-92ab-2fd6f6e0c832 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f06318c-5c05-4950-a6a4-5e9bd906d50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:06 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-681dddcb-63e8-4338-92ab-2fd6f6e0c832 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f06318c-5c05-4950-a6a4-5e9bd906d50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-507160963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f01d2fbc-0346-4aef-8ed3-2cc7c4f00103,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a1ad18f9241c4a5a874bb3deb4504f14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:06Z,use_quota=True,user_id='8315f5fcca324498872ed34a5e8e6c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:06 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-681dddcb-63e8-4338-92ab-2fd6f6e0c832 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a42a18-b71f-4eb0-81a2-7aa10f9301d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:06 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-681dddcb-63e8-4338-92ab-2fd6f6e0c832 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a42a18-b71f-4eb0-81a2-7aa10f9301d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:06 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-681dddcb-63e8-4338-92ab-2fd6f6e0c832 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c39fb9fe-ecdf-4355-8039-11e29ecedf81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:06 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-681dddcb-63e8-4338-92ab-2fd6f6e0c832 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c39fb9fe-ecdf-4355-8039-11e29ecedf81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f01d2fbc-0346-4aef-8ed3-2cc7c4f00103', 'volume_name': 'volume-f01d2fbc-0346-4aef-8ed3-2cc7c4f00103', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:06 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-681dddcb-63e8-4338-92ab-2fd6f6e0c832 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84903572-bb6a-4397-8413-638a42cc13c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:06 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-681dddcb-63e8-4338-92ab-2fd6f6e0c832 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84903572-bb6a-4397-8413-638a42cc13c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:06 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-681dddcb-63e8-4338-92ab-2fd6f6e0c832 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (113df246-9229-42c8-b1b5-5a245085dac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:06 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-681dddcb-63e8-4338-92ab-2fd6f6e0c832 tempest-VolumesGetTest-761816182 None] Volume f01d2fbc-0346-4aef-8ed3-2cc7c4f00103: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f01d2fbc-0346-4aef-8ed3-2cc7c4f00103', 'volume_size': 1}
Apr 02 10:32:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-681dddcb-63e8-4338-92ab-2fd6f6e0c832 tempest-VolumesGetTest-761816182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-681dddcb-63e8-4338-92ab-2fd6f6e0c832 tempest-VolumesGetTest-761816182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:06 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-681dddcb-63e8-4338-92ab-2fd6f6e0c832 tempest-VolumesGetTest-761816182 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-507160963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f01d2fbc-0346-4aef-8ed3-2cc7c4f00103,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a1ad18f9241c4a5a874bb3deb4504f14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:06Z,use_quota=True,user_id='8315f5fcca324498872ed34a5e8e6c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:32:06 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-681dddcb-63e8-4338-92ab-2fd6f6e0c832 tempest-VolumesGetTest-761816182 None] Creating volume f01d2fbc-0346-4aef-8ed3-2cc7c4f00103 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:32:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-681dddcb-63e8-4338-92ab-2fd6f6e0c832 tempest-VolumesGetTest-761816182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-681dddcb-63e8-4338-92ab-2fd6f6e0c832 tempest-VolumesGetTest-761816182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:06 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-681dddcb-63e8-4338-92ab-2fd6f6e0c832 tempest-VolumesGetTest-761816182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:32:06 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-681dddcb-63e8-4338-92ab-2fd6f6e0c832 tempest-VolumesGetTest-761816182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:32:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-681dddcb-63e8-4338-92ab-2fd6f6e0c832 tempest-VolumesGetTest-761816182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:06 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-681dddcb-63e8-4338-92ab-2fd6f6e0c832 tempest-VolumesGetTest-761816182 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:32:06 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-681dddcb-63e8-4338-92ab-2fd6f6e0c832 tempest-VolumesGetTest-761816182 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:32:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-681dddcb-63e8-4338-92ab-2fd6f6e0c832 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f01d2fbc-0346-4aef-8ed3-2cc7c4f00103 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:06 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-4de4c487-a952-4a43-8d3d-59352f781803 tempest-VolumesSnapshotListTestJSON-238667818 None] Lock "cinder-830f0b31-693b-426d-a31d-654c9e7168c1-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:06 devstack sudo[88612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f01d2fbc-0346-4aef-8ed3-2cc7c4f00103 1073741824
Apr 02 10:32:06 devstack sudo[88612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:06 devstack sudo[88612]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-681dddcb-63e8-4338-92ab-2fd6f6e0c832 tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f01d2fbc-0346-4aef-8ed3-2cc7c4f00103 1073741824" returned: 0 in 0.568s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-681dddcb-63e8-4338-92ab-2fd6f6e0c832 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f01d2fbc-0346-4aef-8ed3-2cc7c4f00103 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:06 devstack sudo[88617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f01d2fbc-0346-4aef-8ed3-2cc7c4f00103
Apr 02 10:32:06 devstack sudo[88617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:07 devstack sudo[88617]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-681dddcb-63e8-4338-92ab-2fd6f6e0c832 tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f01d2fbc-0346-4aef-8ed3-2cc7c4f00103" returned: 0 in 0.495s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:07 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-681dddcb-63e8-4338-92ab-2fd6f6e0c832 tempest-VolumesGetTest-761816182 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:32:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-681dddcb-63e8-4338-92ab-2fd6f6e0c832 tempest-VolumesGetTest-761816182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:07 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-681dddcb-63e8-4338-92ab-2fd6f6e0c832 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (113df246-9229-42c8-b1b5-5a245085dac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f01d2fbc-0346-4aef-8ed3-2cc7c4f00103', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:07 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-681dddcb-63e8-4338-92ab-2fd6f6e0c832 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8bc0b58-9e54-4c1f-91e9-3789f1bb5793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:07 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-681dddcb-63e8-4338-92ab-2fd6f6e0c832 tempest-VolumesGetTest-761816182 None] Volume volume-f01d2fbc-0346-4aef-8ed3-2cc7c4f00103 (f01d2fbc-0346-4aef-8ed3-2cc7c4f00103): created successfully
Apr 02 10:32:07 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-681dddcb-63e8-4338-92ab-2fd6f6e0c832 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8bc0b58-9e54-4c1f-91e9-3789f1bb5793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:07 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-681dddcb-63e8-4338-92ab-2fd6f6e0c832 tempest-VolumesGetTest-761816182 None] Flow 'volume_create_manager' (348c73f3-0ed8-4d72-b252-adc623362ca5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:32:07 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-681dddcb-63e8-4338-92ab-2fd6f6e0c832 tempest-VolumesGetTest-761816182 None] Created volume successfully.
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG oslo_service.periodic_task [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:08 devstack sudo[88620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:32:08 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-4536b427-2669-4bce-86aa-57305d546145 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-4536b427-2669-4bce-86aa-57305d546145 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Flow 'volume_create_manager' (7d2edb71-0d4b-4117-a516-a69f478d12f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-4536b427-2669-4bce-86aa-57305d546145 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a2a49b-7b4c-47c1-a030-bdf4f6faff74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-4536b427-2669-4bce-86aa-57305d546145 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a2a49b-7b4c-47c1-a030-bdf4f6faff74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1790997597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=108cb36e-ca5d-4101-a143-951a71e82a78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cd66e45f0e74f2ca71638c8959a1066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:09Z,use_quota=True,user_id='9a359fe54172413cb6a07a5236f61bd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-4536b427-2669-4bce-86aa-57305d546145 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ecfa05a-c678-497f-b77a-34e639825335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-4536b427-2669-4bce-86aa-57305d546145 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ecfa05a-c678-497f-b77a-34e639825335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-4536b427-2669-4bce-86aa-57305d546145 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d509f1-2b14-44e9-8deb-153de8c21edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-4536b427-2669-4bce-86aa-57305d546145 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d509f1-2b14-44e9-8deb-153de8c21edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '108cb36e-ca5d-4101-a143-951a71e82a78', 'volume_name': 'volume-108cb36e-ca5d-4101-a143-951a71e82a78', 'volume_size': 2}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-4536b427-2669-4bce-86aa-57305d546145 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a5bf75d-61cb-4051-b869-2b127a3429c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-4536b427-2669-4bce-86aa-57305d546145 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a5bf75d-61cb-4051-b869-2b127a3429c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-4536b427-2669-4bce-86aa-57305d546145 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de4b8c4-e8a0-4b0e-9a29-3f699fea732e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:08 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-4536b427-2669-4bce-86aa-57305d546145 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Volume 108cb36e-ca5d-4101-a143-951a71e82a78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-108cb36e-ca5d-4101-a143-951a71e82a78', 'volume_size': 2}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-4536b427-2669-4bce-86aa-57305d546145 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-4536b427-2669-4bce-86aa-57305d546145 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-4536b427-2669-4bce-86aa-57305d546145 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1790997597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=108cb36e-ca5d-4101-a143-951a71e82a78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cd66e45f0e74f2ca71638c8959a1066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:09Z,use_quota=True,user_id='9a359fe54172413cb6a07a5236f61bd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-4536b427-2669-4bce-86aa-57305d546145 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Creating volume 108cb36e-ca5d-4101-a143-951a71e82a78 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-4536b427-2669-4bce-86aa-57305d546145 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-4536b427-2669-4bce-86aa-57305d546145 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-4536b427-2669-4bce-86aa-57305d546145 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-4536b427-2669-4bce-86aa-57305d546145 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-4536b427-2669-4bce-86aa-57305d546145 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-4536b427-2669-4bce-86aa-57305d546145 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:32:08 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-4536b427-2669-4bce-86aa-57305d546145 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4536b427-2669-4bce-86aa-57305d546145 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78 2147483648 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-808846dc-9700-4e46-8a1c-e221a5c08a29 tempest-VolumesGetTest-761816182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:32:08 devstack sudo[88622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78 2147483648
Apr 02 10:32:08 devstack sudo[88622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-808846dc-9700-4e46-8a1c-e221a5c08a29 tempest-VolumesGetTest-761816182 None] Flow 'volume_create_manager' (e38f840c-a28c-4ea3-9db2-689616b0673a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-808846dc-9700-4e46-8a1c-e221a5c08a29 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69bdb8b7-ca9f-4a08-9435-14763a4de66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-808846dc-9700-4e46-8a1c-e221a5c08a29 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69bdb8b7-ca9f-4a08-9435-14763a4de66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:32:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1784129973',display_name='tempest-VolumesGetTest-Volume-2142240831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cc0bf04-1275-4736-8dbf-73d20c7b32a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ad18f9241c4a5a874bb3deb4504f14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:09Z,use_quota=True,user_id='8315f5fcca324498872ed34a5e8e6c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-808846dc-9700-4e46-8a1c-e221a5c08a29 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (017d0e0c-d733-416f-a7c5-cf01a8b24922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-808846dc-9700-4e46-8a1c-e221a5c08a29 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (017d0e0c-d733-416f-a7c5-cf01a8b24922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-808846dc-9700-4e46-8a1c-e221a5c08a29 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8243ce0-222d-48e3-a046-384e3827b9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-808846dc-9700-4e46-8a1c-e221a5c08a29 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8243ce0-222d-48e3-a046-384e3827b9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cc0bf04-1275-4736-8dbf-73d20c7b32a5', 'volume_name': 'volume-2cc0bf04-1275-4736-8dbf-73d20c7b32a5', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-808846dc-9700-4e46-8a1c-e221a5c08a29 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ad46290-6667-4181-aeb1-eaf8f321c281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-808846dc-9700-4e46-8a1c-e221a5c08a29 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ad46290-6667-4181-aeb1-eaf8f321c281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-808846dc-9700-4e46-8a1c-e221a5c08a29 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e2a9515-0b37-4110-889c-f961581ed61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:08 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-808846dc-9700-4e46-8a1c-e221a5c08a29 tempest-VolumesGetTest-761816182 None] Volume 2cc0bf04-1275-4736-8dbf-73d20c7b32a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cc0bf04-1275-4736-8dbf-73d20c7b32a5', 'volume_size': 1}
Apr 02 10:32:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-808846dc-9700-4e46-8a1c-e221a5c08a29 tempest-VolumesGetTest-761816182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:09 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.417s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:09 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:32:09 devstack sudo[88622]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4536b427-2669-4bce-86aa-57305d546145 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78 2147483648" returned: 0 in 0.472s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4536b427-2669-4bce-86aa-57305d546145 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:09 devstack sudo[88628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78
Apr 02 10:32:09 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:09 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4536b427-2669-4bce-86aa-57305d546145 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78" returned: 0 in 0.395s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:09 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-4536b427-2669-4bce-86aa-57305d546145 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:32:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-4536b427-2669-4bce-86aa-57305d546145 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-808846dc-9700-4e46-8a1c-e221a5c08a29 tempest-VolumesGetTest-761816182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.811s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:09 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-808846dc-9700-4e46-8a1c-e221a5c08a29 tempest-VolumesGetTest-761816182 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:32:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1784129973',display_name='tempest-VolumesGetTest-Volume-2142240831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cc0bf04-1275-4736-8dbf-73d20c7b32a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ad18f9241c4a5a874bb3deb4504f14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:09Z,use_quota=True,user_id='8315f5fcca324498872ed34a5e8e6c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:32:09 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-808846dc-9700-4e46-8a1c-e221a5c08a29 tempest-VolumesGetTest-761816182 None] Creating volume 2cc0bf04-1275-4736-8dbf-73d20c7b32a5 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:32:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-808846dc-9700-4e46-8a1c-e221a5c08a29 tempest-VolumesGetTest-761816182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-808846dc-9700-4e46-8a1c-e221a5c08a29 tempest-VolumesGetTest-761816182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:09 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-808846dc-9700-4e46-8a1c-e221a5c08a29 tempest-VolumesGetTest-761816182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:32:09 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-808846dc-9700-4e46-8a1c-e221a5c08a29 tempest-VolumesGetTest-761816182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:32:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-808846dc-9700-4e46-8a1c-e221a5c08a29 tempest-VolumesGetTest-761816182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:09 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-808846dc-9700-4e46-8a1c-e221a5c08a29 tempest-VolumesGetTest-761816182 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:32:09 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-808846dc-9700-4e46-8a1c-e221a5c08a29 tempest-VolumesGetTest-761816182 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:32:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-808846dc-9700-4e46-8a1c-e221a5c08a29 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2cc0bf04-1275-4736-8dbf-73d20c7b32a5 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:09 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-4536b427-2669-4bce-86aa-57305d546145 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de4b8c4-e8a0-4b0e-9a29-3f699fea732e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-108cb36e-ca5d-4101-a143-951a71e82a78', 'volume_size': 2}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:09 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-4536b427-2669-4bce-86aa-57305d546145 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ac5318c-1050-46f1-8d1a-33885233416b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:09 devstack sudo[88631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2cc0bf04-1275-4736-8dbf-73d20c7b32a5 1073741824
Apr 02 10:32:09 devstack sudo[88631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:09 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-4536b427-2669-4bce-86aa-57305d546145 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Volume volume-108cb36e-ca5d-4101-a143-951a71e82a78 (108cb36e-ca5d-4101-a143-951a71e82a78): created successfully
Apr 02 10:32:09 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-4536b427-2669-4bce-86aa-57305d546145 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ac5318c-1050-46f1-8d1a-33885233416b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:09 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-4536b427-2669-4bce-86aa-57305d546145 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Flow 'volume_create_manager' (7d2edb71-0d4b-4117-a516-a69f478d12f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:32:09 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-4536b427-2669-4bce-86aa-57305d546145 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Created volume successfully.
Apr 02 10:32:10 devstack sudo[88631]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-808846dc-9700-4e46-8a1c-e221a5c08a29 tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2cc0bf04-1275-4736-8dbf-73d20c7b32a5 1073741824" returned: 0 in 0.460s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-808846dc-9700-4e46-8a1c-e221a5c08a29 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2cc0bf04-1275-4736-8dbf-73d20c7b32a5 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:10 devstack sudo[88636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2cc0bf04-1275-4736-8dbf-73d20c7b32a5
Apr 02 10:32:10 devstack sudo[88636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:10 devstack sudo[88636]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-808846dc-9700-4e46-8a1c-e221a5c08a29 tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2cc0bf04-1275-4736-8dbf-73d20c7b32a5" returned: 0 in 0.376s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:10 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-808846dc-9700-4e46-8a1c-e221a5c08a29 tempest-VolumesGetTest-761816182 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:32:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-808846dc-9700-4e46-8a1c-e221a5c08a29 tempest-VolumesGetTest-761816182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-808846dc-9700-4e46-8a1c-e221a5c08a29 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e2a9515-0b37-4110-889c-f961581ed61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cc0bf04-1275-4736-8dbf-73d20c7b32a5', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-808846dc-9700-4e46-8a1c-e221a5c08a29 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b390cad-4559-4b30-8780-22cf8d086ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:10 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-808846dc-9700-4e46-8a1c-e221a5c08a29 tempest-VolumesGetTest-761816182 None] Volume volume-2cc0bf04-1275-4736-8dbf-73d20c7b32a5 (2cc0bf04-1275-4736-8dbf-73d20c7b32a5): created successfully
Apr 02 10:32:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-808846dc-9700-4e46-8a1c-e221a5c08a29 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b390cad-4559-4b30-8780-22cf8d086ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-808846dc-9700-4e46-8a1c-e221a5c08a29 tempest-VolumesGetTest-761816182 None] Flow 'volume_create_manager' (e38f840c-a28c-4ea3-9db2-689616b0673a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:32:10 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-808846dc-9700-4e46-8a1c-e221a5c08a29 tempest-VolumesGetTest-761816182 None] Created volume successfully.
Apr 02 10:32:10 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3165030c-a87c-489a-804d-90ac093c2ef3 tempest-VolumesGetTest-761816182 None] Acquiring lock "cinder-2cc0bf04-1275-4736-8dbf-73d20c7b32a5-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-67222288-84f8-41da-94c0-fb42c9435d2e tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-67222288-84f8-41da-94c0-fb42c9435d2e tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:10 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3165030c-a87c-489a-804d-90ac093c2ef3 tempest-VolumesGetTest-761816182 None] Lock "cinder-2cc0bf04-1275-4736-8dbf-73d20c7b32a5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:10 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-67222288-84f8-41da-94c0-fb42c9435d2e tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Creating offline snapshot 8fabce00-f792-4178-ac6f-9d950214fc22 of volume 108cb36e-ca5d-4101-a143-951a71e82a78 {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:32:10 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b817c9a8-ea3b-43a8-9c33-da5b1476f8eb]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:32:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-67222288-84f8-41da-94c0-fb42c9435d2e tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:10 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3165030c-a87c-489a-804d-90ac093c2ef3 tempest-VolumesGetTest-761816182 None] Acquiring lock "cinder-quobyte-2cc0bf04-1275-4736-8dbf-73d20c7b32a5" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:10 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3165030c-a87c-489a-804d-90ac093c2ef3 tempest-VolumesGetTest-761816182 None] Lock "cinder-quobyte-2cc0bf04-1275-4736-8dbf-73d20c7b32a5" acquired by "delete_volume" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:11 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6771355-4593-47a7-aa83-e102030210f7]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:32:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3165030c-a87c-489a-804d-90ac093c2ef3 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2cc0bf04-1275-4736-8dbf-73d20c7b32a5 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:11 devstack sudo[88640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78
Apr 02 10:32:11 devstack sudo[88640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:11 devstack sudo[88641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2cc0bf04-1275-4736-8dbf-73d20c7b32a5
Apr 02 10:32:11 devstack sudo[88641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:11 devstack sudo[88640]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-67222288-84f8-41da-94c0-fb42c9435d2e tempest-VolumesSnapshotNegativeTestJSON-97582535 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78" returned: 0 in 0.462s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-67222288-84f8-41da-94c0-fb42c9435d2e tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78.8fabce00-f792-4178-ac6f-9d950214fc22 2G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:11 devstack sudo[88650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78.8fabce00-f792-4178-ac6f-9d950214fc22 2G
Apr 02 10:32:11 devstack sudo[88650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:11 devstack sudo[88641]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3165030c-a87c-489a-804d-90ac093c2ef3 tempest-VolumesGetTest-761816182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2cc0bf04-1275-4736-8dbf-73d20c7b32a5" returned: 0 in 0.482s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3165030c-a87c-489a-804d-90ac093c2ef3 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2cc0bf04-1275-4736-8dbf-73d20c7b32a5 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:11 devstack sudo[88652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2cc0bf04-1275-4736-8dbf-73d20c7b32a5
Apr 02 10:32:11 devstack sudo[88652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:11 devstack sudo[88650]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-67222288-84f8-41da-94c0-fb42c9435d2e tempest-VolumesSnapshotNegativeTestJSON-97582535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78.8fabce00-f792-4178-ac6f-9d950214fc22 2G" returned: 0 in 0.442s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-67222288-84f8-41da-94c0-fb42c9435d2e tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-108cb36e-ca5d-4101-a143-951a71e82a78 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78.8fabce00-f792-4178-ac6f-9d950214fc22 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:11 devstack sudo[88658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-108cb36e-ca5d-4101-a143-951a71e82a78 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78.8fabce00-f792-4178-ac6f-9d950214fc22
Apr 02 10:32:11 devstack sudo[88658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:11 devstack sudo[88652]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3165030c-a87c-489a-804d-90ac093c2ef3 tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2cc0bf04-1275-4736-8dbf-73d20c7b32a5" returned: 0 in 0.477s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:11 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3165030c-a87c-489a-804d-90ac093c2ef3 tempest-VolumesGetTest-761816182 None] Lock "cinder-quobyte-2cc0bf04-1275-4736-8dbf-73d20c7b32a5" released by "delete_volume" :: held 0.989s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:12 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-3165030c-a87c-489a-804d-90ac093c2ef3 tempest-VolumesGetTest-761816182 None] Created reservations ['c710400a-8e7b-44ee-8098-406e75626efc', '7e11b509-d21f-4056-a03c-8ce823652e69', '1b2ab240-32be-4e16-83c2-ca92dd12b101', 'd112f1a4-630d-4810-a864-4ed1df03c70f'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:32:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3165030c-a87c-489a-804d-90ac093c2ef3 tempest-VolumesGetTest-761816182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3165030c-a87c-489a-804d-90ac093c2ef3 tempest-VolumesGetTest-761816182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:12 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3165030c-a87c-489a-804d-90ac093c2ef3 tempest-VolumesGetTest-761816182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:32:12 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3165030c-a87c-489a-804d-90ac093c2ef3 tempest-VolumesGetTest-761816182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:32:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3165030c-a87c-489a-804d-90ac093c2ef3 tempest-VolumesGetTest-761816182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3165030c-a87c-489a-804d-90ac093c2ef3 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:12 devstack sudo[88661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:32:12 devstack sudo[88661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:12 devstack sudo[88658]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-67222288-84f8-41da-94c0-fb42c9435d2e tempest-VolumesSnapshotNegativeTestJSON-97582535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-108cb36e-ca5d-4101-a143-951a71e82a78 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78.8fabce00-f792-4178-ac6f-9d950214fc22" returned: 0 in 0.492s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:12 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-67222288-84f8-41da-94c0-fb42c9435d2e tempest-VolumesSnapshotNegativeTestJSON-97582535 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78.8fabce00-f792-4178-ac6f-9d950214fc22 is being set with open permissions: ugo+rw
Apr 02 10:32:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-67222288-84f8-41da-94c0-fb42c9435d2e tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78.8fabce00-f792-4178-ac6f-9d950214fc22 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:12 devstack sudo[88666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78.8fabce00-f792-4178-ac6f-9d950214fc22
Apr 02 10:32:12 devstack sudo[88666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:12 devstack sudo[88661]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3165030c-a87c-489a-804d-90ac093c2ef3 tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.413s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:12 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-3165030c-a87c-489a-804d-90ac093c2ef3 tempest-VolumesGetTest-761816182 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:32:12 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-3165030c-a87c-489a-804d-90ac093c2ef3 tempest-VolumesGetTest-761816182 None] Deleted volume successfully.
Apr 02 10:32:12 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3165030c-a87c-489a-804d-90ac093c2ef3 tempest-VolumesGetTest-761816182 None] Lock "cinder-2cc0bf04-1275-4736-8dbf-73d20c7b32a5-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:12 devstack sudo[88666]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-67222288-84f8-41da-94c0-fb42c9435d2e tempest-VolumesSnapshotNegativeTestJSON-97582535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78.8fabce00-f792-4178-ac6f-9d950214fc22" returned: 0 in 0.408s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-67222288-84f8-41da-94c0-fb42c9435d2e tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:12 devstack sudo[88670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78.info
Apr 02 10:32:12 devstack sudo[88670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:13 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-40b824ef-4838-4f0a-bf3c-758e7a329770 tempest-VolumesGetTest-761816182 None] Acquiring lock "cinder-f01d2fbc-0346-4aef-8ed3-2cc7c4f00103-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:13 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-40b824ef-4838-4f0a-bf3c-758e7a329770 tempest-VolumesGetTest-761816182 None] Lock "cinder-f01d2fbc-0346-4aef-8ed3-2cc7c4f00103-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:13 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-40b824ef-4838-4f0a-bf3c-758e7a329770 tempest-VolumesGetTest-761816182 None] Acquiring lock "cinder-quobyte-f01d2fbc-0346-4aef-8ed3-2cc7c4f00103" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:13 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-40b824ef-4838-4f0a-bf3c-758e7a329770 tempest-VolumesGetTest-761816182 None] Lock "cinder-quobyte-f01d2fbc-0346-4aef-8ed3-2cc7c4f00103" acquired by "delete_volume" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:13 devstack sudo[88670]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-67222288-84f8-41da-94c0-fb42c9435d2e tempest-VolumesSnapshotNegativeTestJSON-97582535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78.info" returned: 0 in 0.451s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:13 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-67222288-84f8-41da-94c0-fb42c9435d2e tempest-VolumesSnapshotNegativeTestJSON-97582535 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78.info is being set with open permissions: ugo+rw
Apr 02 10:32:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-67222288-84f8-41da-94c0-fb42c9435d2e tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:13 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a879b4f-0042-48e3-94e7-a1808c4b3cf0]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:32:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-40b824ef-4838-4f0a-bf3c-758e7a329770 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f01d2fbc-0346-4aef-8ed3-2cc7c4f00103 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:13 devstack sudo[88673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78.info
Apr 02 10:32:13 devstack sudo[88673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:13 devstack sudo[88674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f01d2fbc-0346-4aef-8ed3-2cc7c4f00103
Apr 02 10:32:13 devstack sudo[88674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:13 devstack sudo[88673]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-67222288-84f8-41da-94c0-fb42c9435d2e tempest-VolumesSnapshotNegativeTestJSON-97582535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78.info" returned: 0 in 0.393s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-67222288-84f8-41da-94c0-fb42c9435d2e tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.710s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:13 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-67222288-84f8-41da-94c0-fb42c9435d2e tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Create snapshot completed successfully
Apr 02 10:32:13 devstack sudo[88674]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-40b824ef-4838-4f0a-bf3c-758e7a329770 tempest-VolumesGetTest-761816182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f01d2fbc-0346-4aef-8ed3-2cc7c4f00103" returned: 0 in 0.503s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-40b824ef-4838-4f0a-bf3c-758e7a329770 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f01d2fbc-0346-4aef-8ed3-2cc7c4f00103 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:13 devstack sudo[88681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f01d2fbc-0346-4aef-8ed3-2cc7c4f00103
Apr 02 10:32:13 devstack sudo[88681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:14 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-74d7e2ae-9c20-4c0c-b6d4-896d38483e46 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Acquiring lock "cinder-8fabce00-f792-4178-ac6f-9d950214fc22-delete_snapshot" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:14 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-74d7e2ae-9c20-4c0c-b6d4-896d38483e46 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Lock "cinder-8fabce00-f792-4178-ac6f-9d950214fc22-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:14 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-74d7e2ae-9c20-4c0c-b6d4-896d38483e46 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Acquiring lock "cinder-quobyte-108cb36e-ca5d-4101-a143-951a71e82a78" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:14 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-74d7e2ae-9c20-4c0c-b6d4-896d38483e46 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Lock "cinder-quobyte-108cb36e-ca5d-4101-a143-951a71e82a78" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:14 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-74d7e2ae-9c20-4c0c-b6d4-896d38483e46 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Acquiring lock "cinder-quobyte-8fabce00-f792-4178-ac6f-9d950214fc22" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:14 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-74d7e2ae-9c20-4c0c-b6d4-896d38483e46 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Lock "cinder-quobyte-8fabce00-f792-4178-ac6f-9d950214fc22" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:14 devstack sudo[88681]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:14 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-74d7e2ae-9c20-4c0c-b6d4-896d38483e46 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Deleting offline snapshot 8fabce00-f792-4178-ac6f-9d950214fc22 of volume 108cb36e-ca5d-4101-a143-951a71e82a78 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:32:14 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-74d7e2ae-9c20-4c0c-b6d4-896d38483e46 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] snapshot_file for this snap is: volume-108cb36e-ca5d-4101-a143-951a71e82a78.8fabce00-f792-4178-ac6f-9d950214fc22 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:32:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-40b824ef-4838-4f0a-bf3c-758e7a329770 tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f01d2fbc-0346-4aef-8ed3-2cc7c4f00103" returned: 0 in 0.436s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:14 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed522464-853f-43af-81e7-c64bd98225ff]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:32:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-74d7e2ae-9c20-4c0c-b6d4-896d38483e46 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78.8fabce00-f792-4178-ac6f-9d950214fc22 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:14 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-40b824ef-4838-4f0a-bf3c-758e7a329770 tempest-VolumesGetTest-761816182 None] Lock "cinder-quobyte-f01d2fbc-0346-4aef-8ed3-2cc7c4f00103" released by "delete_volume" :: held 0.978s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:14 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-40b824ef-4838-4f0a-bf3c-758e7a329770 tempest-VolumesGetTest-761816182 None] Created reservations ['27755bcd-1c72-47ba-a2a6-f8ef4801cf88', '92302e53-5ff7-410f-bc14-02d9bda0aaa9', '329aa30e-881d-4e54-805f-968981403a98', 'ba074908-ae7d-4f71-a6ba-da879ed5a32b'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:32:14 devstack sudo[88684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78.8fabce00-f792-4178-ac6f-9d950214fc22
Apr 02 10:32:14 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-40b824ef-4838-4f0a-bf3c-758e7a329770 tempest-VolumesGetTest-761816182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-40b824ef-4838-4f0a-bf3c-758e7a329770 tempest-VolumesGetTest-761816182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:14 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-40b824ef-4838-4f0a-bf3c-758e7a329770 tempest-VolumesGetTest-761816182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:32:14 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-40b824ef-4838-4f0a-bf3c-758e7a329770 tempest-VolumesGetTest-761816182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:32:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-40b824ef-4838-4f0a-bf3c-758e7a329770 tempest-VolumesGetTest-761816182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-40b824ef-4838-4f0a-bf3c-758e7a329770 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:14 devstack sudo[88686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:32:14 devstack sudo[88686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:14 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-74d7e2ae-9c20-4c0c-b6d4-896d38483e46 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78.8fabce00-f792-4178-ac6f-9d950214fc22" returned: 0 in 0.495s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:14 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-74d7e2ae-9c20-4c0c-b6d4-896d38483e46 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-108cb36e-ca5d-4101-a143-951a71e82a78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:32:14 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[321b23db-87e0-47b2-80b4-3d8f149d3d9b]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:32:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-74d7e2ae-9c20-4c0c-b6d4-896d38483e46 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:14 devstack sudo[88686]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-40b824ef-4838-4f0a-bf3c-758e7a329770 tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.434s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:14 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-40b824ef-4838-4f0a-bf3c-758e7a329770 tempest-VolumesGetTest-761816182 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:32:14 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-40b824ef-4838-4f0a-bf3c-758e7a329770 tempest-VolumesGetTest-761816182 None] Deleted volume successfully.
Apr 02 10:32:14 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-40b824ef-4838-4f0a-bf3c-758e7a329770 tempest-VolumesGetTest-761816182 None] Lock "cinder-f01d2fbc-0346-4aef-8ed3-2cc7c4f00103-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:14 devstack sudo[88692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78
Apr 02 10:32:14 devstack sudo[88692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:15 devstack sudo[88692]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-74d7e2ae-9c20-4c0c-b6d4-896d38483e46 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78" returned: 0 in 0.474s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-74d7e2ae-9c20-4c0c-b6d4-896d38483e46 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78.8fabce00-f792-4178-ac6f-9d950214fc22 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:15 devstack sudo[88697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78.8fabce00-f792-4178-ac6f-9d950214fc22
Apr 02 10:32:15 devstack sudo[88697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:15 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8b06ee3-090f-44b4-8c13-9e1f5b0274b8 tempest-VolumesGetTest-761816182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:32:15 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-a8b06ee3-090f-44b4-8c13-9e1f5b0274b8 tempest-VolumesGetTest-761816182 None] Flow 'volume_create_manager' (8e960560-533c-4f81-9926-e593dcf16842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:32:15 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-a8b06ee3-090f-44b4-8c13-9e1f5b0274b8 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7633b697-4d60-4616-a41c-c0560c5e047b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:15 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-a8b06ee3-090f-44b4-8c13-9e1f5b0274b8 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7633b697-4d60-4616-a41c-c0560c5e047b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1234429156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9214e06c-361a-4c0f-8ebb-a056fb86e975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ad18f9241c4a5a874bb3deb4504f14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:16Z,use_quota=True,user_id='8315f5fcca324498872ed34a5e8e6c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:15 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-a8b06ee3-090f-44b4-8c13-9e1f5b0274b8 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36c0583d-8879-4390-b2d9-cfce1d9b9acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:15 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-a8b06ee3-090f-44b4-8c13-9e1f5b0274b8 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36c0583d-8879-4390-b2d9-cfce1d9b9acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:15 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-a8b06ee3-090f-44b4-8c13-9e1f5b0274b8 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bdfb4c3-d74b-45a8-9e9c-c9c7f0c851c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:15 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-a8b06ee3-090f-44b4-8c13-9e1f5b0274b8 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bdfb4c3-d74b-45a8-9e9c-c9c7f0c851c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9214e06c-361a-4c0f-8ebb-a056fb86e975', 'volume_name': 'volume-9214e06c-361a-4c0f-8ebb-a056fb86e975', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:15 devstack sudo[88697]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:15 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-a8b06ee3-090f-44b4-8c13-9e1f5b0274b8 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34f9da51-7144-4ff2-8db0-47bc34fff34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:15 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-a8b06ee3-090f-44b4-8c13-9e1f5b0274b8 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34f9da51-7144-4ff2-8db0-47bc34fff34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:15 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-a8b06ee3-090f-44b4-8c13-9e1f5b0274b8 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abbce7d7-41f0-4126-aad9-6b19d4d1b67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:15 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-a8b06ee3-090f-44b4-8c13-9e1f5b0274b8 tempest-VolumesGetTest-761816182 None] Volume 9214e06c-361a-4c0f-8ebb-a056fb86e975: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9214e06c-361a-4c0f-8ebb-a056fb86e975', 'volume_size': 1}
Apr 02 10:32:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a8b06ee3-090f-44b4-8c13-9e1f5b0274b8 tempest-VolumesGetTest-761816182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a8b06ee3-090f-44b4-8c13-9e1f5b0274b8 tempest-VolumesGetTest-761816182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-a8b06ee3-090f-44b4-8c13-9e1f5b0274b8 tempest-VolumesGetTest-761816182 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1234429156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9214e06c-361a-4c0f-8ebb-a056fb86e975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ad18f9241c4a5a874bb3deb4504f14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:16Z,use_quota=True,user_id='8315f5fcca324498872ed34a5e8e6c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:32:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-a8b06ee3-090f-44b4-8c13-9e1f5b0274b8 tempest-VolumesGetTest-761816182 None] Creating volume 9214e06c-361a-4c0f-8ebb-a056fb86e975 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:32:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a8b06ee3-090f-44b4-8c13-9e1f5b0274b8 tempest-VolumesGetTest-761816182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a8b06ee3-090f-44b4-8c13-9e1f5b0274b8 tempest-VolumesGetTest-761816182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-a8b06ee3-090f-44b4-8c13-9e1f5b0274b8 tempest-VolumesGetTest-761816182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:32:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-a8b06ee3-090f-44b4-8c13-9e1f5b0274b8 tempest-VolumesGetTest-761816182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:32:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a8b06ee3-090f-44b4-8c13-9e1f5b0274b8 tempest-VolumesGetTest-761816182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-a8b06ee3-090f-44b4-8c13-9e1f5b0274b8 tempest-VolumesGetTest-761816182 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:32:15 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-a8b06ee3-090f-44b4-8c13-9e1f5b0274b8 tempest-VolumesGetTest-761816182 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:32:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a8b06ee3-090f-44b4-8c13-9e1f5b0274b8 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-74d7e2ae-9c20-4c0c-b6d4-896d38483e46 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78.8fabce00-f792-4178-ac6f-9d950214fc22" returned: 0 in 0.539s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-74d7e2ae-9c20-4c0c-b6d4-896d38483e46 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78.8fabce00-f792-4178-ac6f-9d950214fc22 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:15 devstack sudo[88702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975 1073741824
Apr 02 10:32:15 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:15 devstack sudo[88703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78.8fabce00-f792-4178-ac6f-9d950214fc22
Apr 02 10:32:15 devstack sudo[88703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:16 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a8b06ee3-090f-44b4-8c13-9e1f5b0274b8 tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975 1073741824" returned: 0 in 0.508s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:16 devstack sudo[88703]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-74d7e2ae-9c20-4c0c-b6d4-896d38483e46 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78.8fabce00-f792-4178-ac6f-9d950214fc22" returned: 0 in 0.515s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a8b06ee3-090f-44b4-8c13-9e1f5b0274b8 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:16 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-74d7e2ae-9c20-4c0c-b6d4-896d38483e46 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Lock "cinder-quobyte-8fabce00-f792-4178-ac6f-9d950214fc22" released by "_delete_snapshot" :: held 2.106s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:16 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-74d7e2ae-9c20-4c0c-b6d4-896d38483e46 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Lock "cinder-quobyte-108cb36e-ca5d-4101-a143-951a71e82a78" released by "delete_snapshot" :: held 2.122s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:16 devstack sudo[88710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975
Apr 02 10:32:16 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:16 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-74d7e2ae-9c20-4c0c-b6d4-896d38483e46 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Created reservations ['cea8ad99-354e-4e9d-9708-4083b55f5950', '04107368-64bc-4003-839a-b62d0a7501dc', '81ec3344-8eb9-4846-b902-5c96e41bc5b4', '44c1e345-706e-4cac-994d-8335f6b1bde5'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:32:16 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-74d7e2ae-9c20-4c0c-b6d4-896d38483e46 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Delete snapshot completed successfully.
Apr 02 10:32:16 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-74d7e2ae-9c20-4c0c-b6d4-896d38483e46 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Lock "cinder-8fabce00-f792-4178-ac6f-9d950214fc22-delete_snapshot" released by "delete_snapshot" :: held 2.216s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:16 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a8b06ee3-090f-44b4-8c13-9e1f5b0274b8 tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975" returned: 0 in 0.419s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:16 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-a8b06ee3-090f-44b4-8c13-9e1f5b0274b8 tempest-VolumesGetTest-761816182 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:32:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-a8b06ee3-090f-44b4-8c13-9e1f5b0274b8 tempest-VolumesGetTest-761816182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:16 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-a8b06ee3-090f-44b4-8c13-9e1f5b0274b8 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abbce7d7-41f0-4126-aad9-6b19d4d1b67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9214e06c-361a-4c0f-8ebb-a056fb86e975', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:16 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-a8b06ee3-090f-44b4-8c13-9e1f5b0274b8 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42246fcb-6980-4228-9962-21ef330073c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:16 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-a8b06ee3-090f-44b4-8c13-9e1f5b0274b8 tempest-VolumesGetTest-761816182 None] Volume volume-9214e06c-361a-4c0f-8ebb-a056fb86e975 (9214e06c-361a-4c0f-8ebb-a056fb86e975): created successfully
Apr 02 10:32:16 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-a8b06ee3-090f-44b4-8c13-9e1f5b0274b8 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42246fcb-6980-4228-9962-21ef330073c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:16 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-a8b06ee3-090f-44b4-8c13-9e1f5b0274b8 tempest-VolumesGetTest-761816182 None] Flow 'volume_create_manager' (8e960560-533c-4f81-9926-e593dcf16842) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:32:16 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-a8b06ee3-090f-44b4-8c13-9e1f5b0274b8 tempest-VolumesGetTest-761816182 None] Created volume successfully.
Apr 02 10:32:17 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9f811e2c-89f8-4471-b586-7deed32149f1 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Acquiring lock "cinder-108cb36e-ca5d-4101-a143-951a71e82a78-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:17 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9f811e2c-89f8-4471-b586-7deed32149f1 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Lock "cinder-108cb36e-ca5d-4101-a143-951a71e82a78-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:17 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9f811e2c-89f8-4471-b586-7deed32149f1 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Acquiring lock "cinder-quobyte-108cb36e-ca5d-4101-a143-951a71e82a78" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:17 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9f811e2c-89f8-4471-b586-7deed32149f1 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Lock "cinder-quobyte-108cb36e-ca5d-4101-a143-951a71e82a78" acquired by "delete_volume" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:17 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab22390-c100-47f3-a111-9155fa8e2b00]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:32:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9f811e2c-89f8-4471-b586-7deed32149f1 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:17 devstack sudo[88713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78
Apr 02 10:32:17 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:17 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9f811e2c-89f8-4471-b586-7deed32149f1 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78" returned: 0 in 0.525s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9f811e2c-89f8-4471-b586-7deed32149f1 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:17 devstack sudo[88718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78
Apr 02 10:32:17 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:18 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:32:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Flow 'volume_create_manager' (046be10c-33ed-4aad-80dd-ae99f7cf52fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:32:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (379ccb67-b38b-4683-870d-aded78510cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (379ccb67-b38b-4683-870d-aded78510cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1276521216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=758ee138-5b68-48f0-a71e-ad0f36dea823,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a1ad18f9241c4a5a874bb3deb4504f14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=9214e06c-361a-4c0f-8ebb-a056fb86e975,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:18Z,use_quota=True,user_id='8315f5fcca324498872ed34a5e8e6c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49690d91-666e-45e0-9b73-f022e138aa4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49690d91-666e-45e0-9b73-f022e138aa4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bd9eca7-c05b-4fa4-a184-208c446da41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bd9eca7-c05b-4fa4-a184-208c446da41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '758ee138-5b68-48f0-a71e-ad0f36dea823', 'volume_name': 'volume-758ee138-5b68-48f0-a71e-ad0f36dea823', 'volume_size': 1, 'source_volid': '9214e06c-361a-4c0f-8ebb-a056fb86e975', 'source_volstatus': 'available'}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c86ebbf-6114-4083-b7f1-1718f85f3ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c86ebbf-6114-4083-b7f1-1718f85f3ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a4a0f1-2883-43f0-bd3a-38e7c25fcfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:18 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Volume 758ee138-5b68-48f0-a71e-ad0f36dea823: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-758ee138-5b68-48f0-a71e-ad0f36dea823', 'volume_size': 1, 'source_volid': '9214e06c-361a-4c0f-8ebb-a056fb86e975', 'source_volstatus': 'available'}
Apr 02 10:32:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:18 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Cloning volume 9214e06c-361a-4c0f-8ebb-a056fb86e975 to volume 758ee138-5b68-48f0-a71e-ad0f36dea823
Apr 02 10:32:18 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Creating offline snapshot bc3043d0-f593-4da9-850e-842abee4813e of volume 9214e06c-361a-4c0f-8ebb-a056fb86e975 {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:32:18 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f69efc-f0d9-4372-8490-86cceb869796]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:32:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:18 devstack sudo[88720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975
Apr 02 10:32:18 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:18 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9f811e2c-89f8-4471-b586-7deed32149f1 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-108cb36e-ca5d-4101-a143-951a71e82a78" returned: 0 in 0.469s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:18 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9f811e2c-89f8-4471-b586-7deed32149f1 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Lock "cinder-quobyte-108cb36e-ca5d-4101-a143-951a71e82a78" released by "delete_volume" :: held 1.035s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:18 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-9f811e2c-89f8-4471-b586-7deed32149f1 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Created reservations ['05068977-9379-445c-804f-38b163f56c13', 'f25ea6c5-932e-4868-a918-744355b00285', '708a7126-efcb-4eb1-a3b8-6569e24cb56b', '82174ab3-4f1a-4137-974d-f820d2036fc4'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:32:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-9f811e2c-89f8-4471-b586-7deed32149f1 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-9f811e2c-89f8-4471-b586-7deed32149f1 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:18 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-9f811e2c-89f8-4471-b586-7deed32149f1 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:32:18 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-9f811e2c-89f8-4471-b586-7deed32149f1 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:32:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-9f811e2c-89f8-4471-b586-7deed32149f1 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9f811e2c-89f8-4471-b586-7deed32149f1 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:18 devstack sudo[88723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:32:18 devstack sudo[88723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:18 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975" returned: 0 in 0.528s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975.bc3043d0-f593-4da9-850e-842abee4813e 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:18 devstack sudo[88728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975.bc3043d0-f593-4da9-850e-842abee4813e 1G
Apr 02 10:32:18 devstack sudo[88728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:18 devstack sudo[88723]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9f811e2c-89f8-4471-b586-7deed32149f1 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.416s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:18 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-9f811e2c-89f8-4471-b586-7deed32149f1 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:32:18 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-9f811e2c-89f8-4471-b586-7deed32149f1 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Deleted volume successfully.
Apr 02 10:32:18 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9f811e2c-89f8-4471-b586-7deed32149f1 tempest-VolumesSnapshotNegativeTestJSON-97582535 None] Lock "cinder-108cb36e-ca5d-4101-a143-951a71e82a78-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:19 devstack sudo[88728]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975.bc3043d0-f593-4da9-850e-842abee4813e 1G" returned: 0 in 0.477s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9214e06c-361a-4c0f-8ebb-a056fb86e975 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975.bc3043d0-f593-4da9-850e-842abee4813e {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:19 devstack sudo[88734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9214e06c-361a-4c0f-8ebb-a056fb86e975 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975.bc3043d0-f593-4da9-850e-842abee4813e
Apr 02 10:32:19 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:19 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9214e06c-361a-4c0f-8ebb-a056fb86e975 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975.bc3043d0-f593-4da9-850e-842abee4813e" returned: 0 in 0.436s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:19 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975.bc3043d0-f593-4da9-850e-842abee4813e is being set with open permissions: ugo+rw
Apr 02 10:32:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975.bc3043d0-f593-4da9-850e-842abee4813e {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:19 devstack sudo[88739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975.bc3043d0-f593-4da9-850e-842abee4813e
Apr 02 10:32:19 devstack sudo[88739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:20 devstack sudo[88739]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975.bc3043d0-f593-4da9-850e-842abee4813e" returned: 0 in 0.435s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:20 devstack sudo[88742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975.info
Apr 02 10:32:20 devstack sudo[88742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:20 devstack sudo[88742]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975.info" returned: 0 in 0.511s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:20 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975.info is being set with open permissions: ugo+rw
Apr 02 10:32:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:20 devstack sudo[88745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975.info
Apr 02 10:32:20 devstack sudo[88745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:20 devstack sudo[88745]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975.info" returned: 0 in 0.407s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:21 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Acquiring lock "cinder-quobyte-758ee138-5b68-48f0-a71e-ad0f36dea823" by "_copy_volume_from_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:21 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Lock "cinder-quobyte-758ee138-5b68-48f0-a71e-ad0f36dea823" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:21 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] snapshot: bc3043d0-f593-4da9-850e-842abee4813e, volume: 758ee138-5b68-48f0-a71e-ad0f36dea823,  {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 02 10:32:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:21 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:32:21 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:32:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:21 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d24999-5434-44d5-a95a-0cf9872ccf5f]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:32:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975.bc3043d0-f593-4da9-850e-842abee4813e {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:21 devstack sudo[88749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975.bc3043d0-f593-4da9-850e-842abee4813e
Apr 02 10:32:21 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:21 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4ee1263-af45-4799-961a-044a6af89be9 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:32:21 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d4ee1263-af45-4799-961a-044a6af89be9 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Flow 'volume_create_manager' (e5d73a8c-d860-43dd-bc25-e1d9a650e883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:32:21 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d4ee1263-af45-4799-961a-044a6af89be9 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b43947cd-6a36-475f-9720-b8e7b1a94c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:21 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d4ee1263-af45-4799-961a-044a6af89be9 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b43947cd-6a36-475f-9720-b8e7b1a94c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-182970327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c5c08f-05c5-4fc8-b123-1763cb222ccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e274de80404f464c8ad70f5ff5e4d651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:21Z,use_quota=True,user_id='624813ec730b4de18df55083f18f6f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:21 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d4ee1263-af45-4799-961a-044a6af89be9 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b484b3be-7028-45a5-b4e4-644028c0c880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:21 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d4ee1263-af45-4799-961a-044a6af89be9 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b484b3be-7028-45a5-b4e4-644028c0c880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:21 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d4ee1263-af45-4799-961a-044a6af89be9 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb640208-50ea-4ec4-a3ae-cd5a0950f470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:21 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d4ee1263-af45-4799-961a-044a6af89be9 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb640208-50ea-4ec4-a3ae-cd5a0950f470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41c5c08f-05c5-4fc8-b123-1763cb222ccd', 'volume_name': 'volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:21 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d4ee1263-af45-4799-961a-044a6af89be9 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ee79446-4344-4647-8155-d9e8e39197f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:21 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d4ee1263-af45-4799-961a-044a6af89be9 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ee79446-4344-4647-8155-d9e8e39197f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:21 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d4ee1263-af45-4799-961a-044a6af89be9 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd356a50-fc0a-4687-b754-6999829c678e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:21 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-d4ee1263-af45-4799-961a-044a6af89be9 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Volume 41c5c08f-05c5-4fc8-b123-1763cb222ccd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd', 'volume_size': 1}
Apr 02 10:32:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4ee1263-af45-4799-961a-044a6af89be9 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:21 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975.bc3043d0-f593-4da9-850e-842abee4813e" returned: 0 in 0.512s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:21 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9214e06c-361a-4c0f-8ebb-a056fb86e975(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:32:21 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975 {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 02 10:32:21 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Creating direct copy from snapshot {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 02 10:32:21 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c155f7-18be-4389-bec5-e17bc8b32855]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:32:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:21 devstack sudo[88754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975
Apr 02 10:32:21 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:22 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975" returned: 0 in 0.459s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:22 devstack cinder-volume[82102]: DEBUG cinder.utils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Path /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-758ee138-5b68-48f0-a71e-ad0f36dea823 not found in is_blk_device check {{(pid=82102) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 02 10:32:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-758ee138-5b68-48f0-a71e-ad0f36dea823 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:22 devstack sudo[88759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-758ee138-5b68-48f0-a71e-ad0f36dea823
Apr 02 10:32:22 devstack sudo[88759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:23 devstack sudo[88759]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-758ee138-5b68-48f0-a71e-ad0f36dea823" returned: 0 in 1.843s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:23 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4827149d-a4f0-4534-816b-0fb7eea01930]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:32:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:23 devstack sudo[88772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975
Apr 02 10:32:23 devstack sudo[88772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:24 devstack sudo[88772]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975" returned: 0 in 0.564s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:24 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Image conversion details: src /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975, size 1024.00 MB, duration 1.84 sec, destination /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-758ee138-5b68-48f0-a71e-ad0f36dea823 {{(pid=82102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 02 10:32:24 devstack cinder-volume[82102]: INFO cinder.image.image_utils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Converted 1024.00 MB image at 555.41 MB/s
Apr 02 10:32:24 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-758ee138-5b68-48f0-a71e-ad0f36dea823 is being set with open permissions: ugo+rw
Apr 02 10:32:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-758ee138-5b68-48f0-a71e-ad0f36dea823 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:24 devstack sudo[88777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-758ee138-5b68-48f0-a71e-ad0f36dea823
Apr 02 10:32:24 devstack sudo[88777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:24 devstack sudo[88777]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-758ee138-5b68-48f0-a71e-ad0f36dea823" returned: 0 in 0.407s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:24 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Lock "cinder-quobyte-758ee138-5b68-48f0-a71e-ad0f36dea823" released by "_copy_volume_from_snapshot" :: held 3.835s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:24 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Acquiring lock "cinder-quobyte-bc3043d0-f593-4da9-850e-842abee4813e" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:24 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Lock "cinder-quobyte-bc3043d0-f593-4da9-850e-842abee4813e" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:24 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Deleting offline snapshot bc3043d0-f593-4da9-850e-842abee4813e of volume 9214e06c-361a-4c0f-8ebb-a056fb86e975 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:32:24 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] snapshot_file for this snap is: volume-9214e06c-361a-4c0f-8ebb-a056fb86e975.bc3043d0-f593-4da9-850e-842abee4813e {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:32:24 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4fd19d-f704-4858-9889-1dc0df260209]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:32:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975.bc3043d0-f593-4da9-850e-842abee4813e {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:24 devstack sudo[88780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975.bc3043d0-f593-4da9-850e-842abee4813e
Apr 02 10:32:24 devstack sudo[88780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:25 devstack sudo[88780]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975.bc3043d0-f593-4da9-850e-842abee4813e" returned: 0 in 0.456s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:25 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9214e06c-361a-4c0f-8ebb-a056fb86e975(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:32:25 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bc13bb-59e8-4240-a4c7-d84b818031a9]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:32:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:25 devstack sudo[88785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975
Apr 02 10:32:25 devstack sudo[88785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:25 devstack sudo[88785]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975" returned: 0 in 0.485s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975.bc3043d0-f593-4da9-850e-842abee4813e {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:25 devstack sudo[88790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975.bc3043d0-f593-4da9-850e-842abee4813e
Apr 02 10:32:25 devstack sudo[88790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:26 devstack sudo[88790]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975.bc3043d0-f593-4da9-850e-842abee4813e" returned: 0 in 0.435s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975.bc3043d0-f593-4da9-850e-842abee4813e {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:26 devstack sudo[88795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975.bc3043d0-f593-4da9-850e-842abee4813e
Apr 02 10:32:26 devstack sudo[88795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:26 devstack sudo[88795]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975.bc3043d0-f593-4da9-850e-842abee4813e" returned: 0 in 0.424s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:26 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Lock "cinder-quobyte-bc3043d0-f593-4da9-850e-842abee4813e" released by "_delete_snapshot" :: held 1.853s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.605s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4ee1263-af45-4799-961a-044a6af89be9 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.235s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:26 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d4ee1263-af45-4799-961a-044a6af89be9 tempest-CreateVolumesFromSnapshotTest-1116594186 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-182970327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c5c08f-05c5-4fc8-b123-1763cb222ccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e274de80404f464c8ad70f5ff5e4d651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:21Z,use_quota=True,user_id='624813ec730b4de18df55083f18f6f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:32:26 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-d4ee1263-af45-4799-961a-044a6af89be9 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Creating volume 41c5c08f-05c5-4fc8-b123-1763cb222ccd {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:32:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4ee1263-af45-4799-961a-044a6af89be9 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4ee1263-af45-4799-961a-044a6af89be9 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:26 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d4ee1263-af45-4799-961a-044a6af89be9 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:32:26 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d4ee1263-af45-4799-961a-044a6af89be9 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:32:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4ee1263-af45-4799-961a-044a6af89be9 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:26 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d4ee1263-af45-4799-961a-044a6af89be9 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:32:26 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-d4ee1263-af45-4799-961a-044a6af89be9 tempest-CreateVolumesFromSnapshotTest-1116594186 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:32:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d4ee1263-af45-4799-961a-044a6af89be9 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:26 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42a4a0f1-2883-43f0-bd3a-38e7c25fcfb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-758ee138-5b68-48f0-a71e-ad0f36dea823', 'volume_size': 1, 'source_volid': '9214e06c-361a-4c0f-8ebb-a056fb86e975', 'source_volstatus': 'available'}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:26 devstack sudo[88798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd 1073741824
Apr 02 10:32:26 devstack sudo[88798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:26 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4525e03-3296-418d-92c8-b0234e354141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:26 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Volume volume-758ee138-5b68-48f0-a71e-ad0f36dea823 (758ee138-5b68-48f0-a71e-ad0f36dea823): created successfully
Apr 02 10:32:26 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4525e03-3296-418d-92c8-b0234e354141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:26 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Flow 'volume_create_manager' (046be10c-33ed-4aad-80dd-ae99f7cf52fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:32:26 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-5939e4d9-3e6c-42d5-b2c1-85680dd685a3 tempest-VolumesGetTest-761816182 None] Created volume successfully.
Apr 02 10:32:27 devstack sudo[88798]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d4ee1263-af45-4799-961a-044a6af89be9 tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd 1073741824" returned: 0 in 0.557s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d4ee1263-af45-4799-961a-044a6af89be9 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:27 devstack sudo[88803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd
Apr 02 10:32:27 devstack sudo[88803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:27 devstack sudo[88803]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d4ee1263-af45-4799-961a-044a6af89be9 tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd" returned: 0 in 0.479s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:27 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d4ee1263-af45-4799-961a-044a6af89be9 tempest-CreateVolumesFromSnapshotTest-1116594186 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:32:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4ee1263-af45-4799-961a-044a6af89be9 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:27 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d4ee1263-af45-4799-961a-044a6af89be9 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd356a50-fc0a-4687-b754-6999829c678e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:27 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d4ee1263-af45-4799-961a-044a6af89be9 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6223d9df-99cd-4ecd-9c1c-04894f371c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:27 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-d4ee1263-af45-4799-961a-044a6af89be9 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Volume volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd (41c5c08f-05c5-4fc8-b123-1763cb222ccd): created successfully
Apr 02 10:32:27 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d4ee1263-af45-4799-961a-044a6af89be9 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6223d9df-99cd-4ecd-9c1c-04894f371c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:27 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d4ee1263-af45-4799-961a-044a6af89be9 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Flow 'volume_create_manager' (e5d73a8c-d860-43dd-bc25-e1d9a650e883) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:32:27 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-d4ee1263-af45-4799-961a-044a6af89be9 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Created volume successfully.
Apr 02 10:32:28 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fa92799-4e8c-4e3e-accc-3eb2d21474c7 tempest-VolumesGetTest-761816182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:32:28 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3fa92799-4e8c-4e3e-accc-3eb2d21474c7 tempest-VolumesGetTest-761816182 None] Flow 'volume_create_manager' (02a96500-321e-4eba-af17-88f82dc3b1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:32:28 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3fa92799-4e8c-4e3e-accc-3eb2d21474c7 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4746c84-b32b-41d2-9c38-07b39865eadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:28 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3fa92799-4e8c-4e3e-accc-3eb2d21474c7 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4746c84-b32b-41d2-9c38-07b39865eadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:32:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1902506803',display_name='tempest-VolumesGetTest-Volume-987184923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94953593-b9e4-4820-80ea-285701fd2f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ad18f9241c4a5a874bb3deb4504f14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:28Z,use_quota=True,user_id='8315f5fcca324498872ed34a5e8e6c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:28 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3fa92799-4e8c-4e3e-accc-3eb2d21474c7 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da2f37a5-5894-46bc-9032-a4021a21f586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:28 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3fa92799-4e8c-4e3e-accc-3eb2d21474c7 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da2f37a5-5894-46bc-9032-a4021a21f586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:28 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3fa92799-4e8c-4e3e-accc-3eb2d21474c7 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cb5feb9-a3f8-4bb8-af72-56d14b054a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:28 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3fa92799-4e8c-4e3e-accc-3eb2d21474c7 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cb5feb9-a3f8-4bb8-af72-56d14b054a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94953593-b9e4-4820-80ea-285701fd2f8c', 'volume_name': 'volume-94953593-b9e4-4820-80ea-285701fd2f8c', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:28 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3fa92799-4e8c-4e3e-accc-3eb2d21474c7 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (735c9b9f-c62b-449a-bebd-9bcf8b4d118f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:28 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3fa92799-4e8c-4e3e-accc-3eb2d21474c7 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (735c9b9f-c62b-449a-bebd-9bcf8b4d118f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:28 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3fa92799-4e8c-4e3e-accc-3eb2d21474c7 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cc869f0-bd83-403c-9c92-6521abe82d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:28 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-3fa92799-4e8c-4e3e-accc-3eb2d21474c7 tempest-VolumesGetTest-761816182 None] Volume 94953593-b9e4-4820-80ea-285701fd2f8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94953593-b9e4-4820-80ea-285701fd2f8c', 'volume_size': 1}
Apr 02 10:32:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3fa92799-4e8c-4e3e-accc-3eb2d21474c7 tempest-VolumesGetTest-761816182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3fa92799-4e8c-4e3e-accc-3eb2d21474c7 tempest-VolumesGetTest-761816182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:28 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3fa92799-4e8c-4e3e-accc-3eb2d21474c7 tempest-VolumesGetTest-761816182 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:32:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1902506803',display_name='tempest-VolumesGetTest-Volume-987184923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94953593-b9e4-4820-80ea-285701fd2f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ad18f9241c4a5a874bb3deb4504f14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:28Z,use_quota=True,user_id='8315f5fcca324498872ed34a5e8e6c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:32:28 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-3fa92799-4e8c-4e3e-accc-3eb2d21474c7 tempest-VolumesGetTest-761816182 None] Creating volume 94953593-b9e4-4820-80ea-285701fd2f8c {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:32:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3fa92799-4e8c-4e3e-accc-3eb2d21474c7 tempest-VolumesGetTest-761816182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3fa92799-4e8c-4e3e-accc-3eb2d21474c7 tempest-VolumesGetTest-761816182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:28 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3fa92799-4e8c-4e3e-accc-3eb2d21474c7 tempest-VolumesGetTest-761816182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:32:28 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3fa92799-4e8c-4e3e-accc-3eb2d21474c7 tempest-VolumesGetTest-761816182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:32:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3fa92799-4e8c-4e3e-accc-3eb2d21474c7 tempest-VolumesGetTest-761816182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:28 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3fa92799-4e8c-4e3e-accc-3eb2d21474c7 tempest-VolumesGetTest-761816182 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:32:28 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-3fa92799-4e8c-4e3e-accc-3eb2d21474c7 tempest-VolumesGetTest-761816182 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:32:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3fa92799-4e8c-4e3e-accc-3eb2d21474c7 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-94953593-b9e4-4820-80ea-285701fd2f8c 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:28 devstack sudo[88806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-94953593-b9e4-4820-80ea-285701fd2f8c 1073741824
Apr 02 10:32:28 devstack sudo[88806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:28 devstack sudo[88806]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3fa92799-4e8c-4e3e-accc-3eb2d21474c7 tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-94953593-b9e4-4820-80ea-285701fd2f8c 1073741824" returned: 0 in 0.523s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3fa92799-4e8c-4e3e-accc-3eb2d21474c7 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-94953593-b9e4-4820-80ea-285701fd2f8c {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:28 devstack sudo[88811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-94953593-b9e4-4820-80ea-285701fd2f8c
Apr 02 10:32:28 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-7c9ab895-d634-464c-8061-0b218986778d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:29 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3fa92799-4e8c-4e3e-accc-3eb2d21474c7 tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-94953593-b9e4-4820-80ea-285701fd2f8c" returned: 0 in 0.467s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:29 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3fa92799-4e8c-4e3e-accc-3eb2d21474c7 tempest-VolumesGetTest-761816182 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:32:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3fa92799-4e8c-4e3e-accc-3eb2d21474c7 tempest-VolumesGetTest-761816182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-7c9ab895-d634-464c-8061-0b218986778d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.221s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:29 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-7c9ab895-d634-464c-8061-0b218986778d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Creating offline snapshot 4b8a5bca-2099-498a-9c2d-d2e28627edea of volume 41c5c08f-05c5-4fc8-b123-1763cb222ccd {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:32:29 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3fa92799-4e8c-4e3e-accc-3eb2d21474c7 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cc869f0-bd83-403c-9c92-6521abe82d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94953593-b9e4-4820-80ea-285701fd2f8c', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:29 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3fa92799-4e8c-4e3e-accc-3eb2d21474c7 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3965dd8-5e47-466c-8ff6-792e3a465ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:29 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff76643-1090-4168-bfe7-0cf0a737ec98]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:32:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7c9ab895-d634-464c-8061-0b218986778d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:29 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-3fa92799-4e8c-4e3e-accc-3eb2d21474c7 tempest-VolumesGetTest-761816182 None] Volume volume-94953593-b9e4-4820-80ea-285701fd2f8c (94953593-b9e4-4820-80ea-285701fd2f8c): created successfully
Apr 02 10:32:29 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3fa92799-4e8c-4e3e-accc-3eb2d21474c7 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3965dd8-5e47-466c-8ff6-792e3a465ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:29 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3fa92799-4e8c-4e3e-accc-3eb2d21474c7 tempest-VolumesGetTest-761816182 None] Flow 'volume_create_manager' (02a96500-321e-4eba-af17-88f82dc3b1ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:32:29 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-3fa92799-4e8c-4e3e-accc-3eb2d21474c7 tempest-VolumesGetTest-761816182 None] Created volume successfully.
Apr 02 10:32:29 devstack sudo[88816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd
Apr 02 10:32:29 devstack sudo[88816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:29 devstack sudo[88816]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7c9ab895-d634-464c-8061-0b218986778d tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd" returned: 0 in 0.495s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7c9ab895-d634-464c-8061-0b218986778d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd.4b8a5bca-2099-498a-9c2d-d2e28627edea 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:29 devstack sudo[88821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd.4b8a5bca-2099-498a-9c2d-d2e28627edea 1G
Apr 02 10:32:29 devstack sudo[88821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:30 devstack sudo[88821]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7c9ab895-d634-464c-8061-0b218986778d tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd.4b8a5bca-2099-498a-9c2d-d2e28627edea 1G" returned: 0 in 0.469s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7c9ab895-d634-464c-8061-0b218986778d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd.4b8a5bca-2099-498a-9c2d-d2e28627edea {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:30 devstack sudo[88826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd.4b8a5bca-2099-498a-9c2d-d2e28627edea
Apr 02 10:32:30 devstack sudo[88826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:30 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-4230392e-558e-4697-b32c-725c358edc90 tempest-VolumesGetTest-761816182 None] Acquiring lock "cinder-94953593-b9e4-4820-80ea-285701fd2f8c-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:30 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-4230392e-558e-4697-b32c-725c358edc90 tempest-VolumesGetTest-761816182 None] Lock "cinder-94953593-b9e4-4820-80ea-285701fd2f8c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:30 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-4230392e-558e-4697-b32c-725c358edc90 tempest-VolumesGetTest-761816182 None] Acquiring lock "cinder-quobyte-94953593-b9e4-4820-80ea-285701fd2f8c" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:30 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-4230392e-558e-4697-b32c-725c358edc90 tempest-VolumesGetTest-761816182 None] Lock "cinder-quobyte-94953593-b9e4-4820-80ea-285701fd2f8c" acquired by "delete_volume" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:30 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dff09b-44ba-4d31-93e7-81720c0a6901]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:32:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4230392e-558e-4697-b32c-725c358edc90 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-94953593-b9e4-4820-80ea-285701fd2f8c {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:30 devstack sudo[88828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-94953593-b9e4-4820-80ea-285701fd2f8c
Apr 02 10:32:30 devstack sudo[88828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:30 devstack sudo[88826]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7c9ab895-d634-464c-8061-0b218986778d tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd.4b8a5bca-2099-498a-9c2d-d2e28627edea" returned: 0 in 0.462s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:30 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-7c9ab895-d634-464c-8061-0b218986778d tempest-CreateVolumesFromSnapshotTest-1116594186 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd.4b8a5bca-2099-498a-9c2d-d2e28627edea is being set with open permissions: ugo+rw
Apr 02 10:32:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7c9ab895-d634-464c-8061-0b218986778d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd.4b8a5bca-2099-498a-9c2d-d2e28627edea {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:30 devstack sudo[88833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd.4b8a5bca-2099-498a-9c2d-d2e28627edea
Apr 02 10:32:30 devstack sudo[88833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:30 devstack sudo[88828]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4230392e-558e-4697-b32c-725c358edc90 tempest-VolumesGetTest-761816182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-94953593-b9e4-4820-80ea-285701fd2f8c" returned: 0 in 0.528s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4230392e-558e-4697-b32c-725c358edc90 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-94953593-b9e4-4820-80ea-285701fd2f8c {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:30 devstack sudo[88838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-94953593-b9e4-4820-80ea-285701fd2f8c
Apr 02 10:32:30 devstack sudo[88838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:31 devstack sudo[88833]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7c9ab895-d634-464c-8061-0b218986778d tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd.4b8a5bca-2099-498a-9c2d-d2e28627edea" returned: 0 in 0.427s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7c9ab895-d634-464c-8061-0b218986778d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:31 devstack sudo[88842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd.info
Apr 02 10:32:31 devstack sudo[88842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:31 devstack sudo[88838]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4230392e-558e-4697-b32c-725c358edc90 tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-94953593-b9e4-4820-80ea-285701fd2f8c" returned: 0 in 0.439s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:31 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-4230392e-558e-4697-b32c-725c358edc90 tempest-VolumesGetTest-761816182 None] Lock "cinder-quobyte-94953593-b9e4-4820-80ea-285701fd2f8c" released by "delete_volume" :: held 0.994s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:31 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-4230392e-558e-4697-b32c-725c358edc90 tempest-VolumesGetTest-761816182 None] Created reservations ['bffd015e-b4d5-4135-b15c-251f59bb442e', '6cc62138-290e-4f83-b19a-e802f04e41ec', 'c073f17d-356d-4a77-a120-364e847bf6eb', '15e11778-e369-4650-88d4-bbe2af091410'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:32:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-4230392e-558e-4697-b32c-725c358edc90 tempest-VolumesGetTest-761816182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-4230392e-558e-4697-b32c-725c358edc90 tempest-VolumesGetTest-761816182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:31 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-4230392e-558e-4697-b32c-725c358edc90 tempest-VolumesGetTest-761816182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:32:31 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-4230392e-558e-4697-b32c-725c358edc90 tempest-VolumesGetTest-761816182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:32:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-4230392e-558e-4697-b32c-725c358edc90 tempest-VolumesGetTest-761816182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4230392e-558e-4697-b32c-725c358edc90 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:31 devstack sudo[88845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:32:31 devstack sudo[88845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:31 devstack sudo[88842]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7c9ab895-d634-464c-8061-0b218986778d tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd.info" returned: 0 in 0.466s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:31 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-7c9ab895-d634-464c-8061-0b218986778d tempest-CreateVolumesFromSnapshotTest-1116594186 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd.info is being set with open permissions: ugo+rw
Apr 02 10:32:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7c9ab895-d634-464c-8061-0b218986778d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:31 devstack sudo[88848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd.info
Apr 02 10:32:31 devstack sudo[88848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:31 devstack sudo[88845]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4230392e-558e-4697-b32c-725c358edc90 tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.405s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:31 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-4230392e-558e-4697-b32c-725c358edc90 tempest-VolumesGetTest-761816182 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:32:31 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-4230392e-558e-4697-b32c-725c358edc90 tempest-VolumesGetTest-761816182 None] Deleted volume successfully.
Apr 02 10:32:31 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-4230392e-558e-4697-b32c-725c358edc90 tempest-VolumesGetTest-761816182 None] Lock "cinder-94953593-b9e4-4820-80ea-285701fd2f8c-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:32 devstack sudo[88848]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7c9ab895-d634-464c-8061-0b218986778d tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd.info" returned: 0 in 0.426s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-7c9ab895-d634-464c-8061-0b218986778d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.816s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:32 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-7c9ab895-d634-464c-8061-0b218986778d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Create snapshot completed successfully
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f817aa2-b32c-4438-a723-b16820d8c6c1 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f817aa2-b32c-4438-a723-b16820d8c6c1 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Flow 'volume_create_manager' (ecd1146a-797e-4c97-a3f6-341e4dda223e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f817aa2-b32c-4438-a723-b16820d8c6c1 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8290bb69-5ad1-44ba-a9ce-6a7ace461fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f817aa2-b32c-4438-a723-b16820d8c6c1 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8290bb69-5ad1-44ba-a9ce-6a7ace461fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-304163535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=622f8926-853b-423d-a8e3-c918431fd5ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e274de80404f464c8ad70f5ff5e4d651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:32Z,use_quota=True,user_id='624813ec730b4de18df55083f18f6f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f817aa2-b32c-4438-a723-b16820d8c6c1 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0722f56a-973e-4a5f-a574-74fb371c072c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f817aa2-b32c-4438-a723-b16820d8c6c1 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0722f56a-973e-4a5f-a574-74fb371c072c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f817aa2-b32c-4438-a723-b16820d8c6c1 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a227bce-8c5a-4869-a7f9-939c3c95371b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f817aa2-b32c-4438-a723-b16820d8c6c1 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a227bce-8c5a-4869-a7f9-939c3c95371b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '622f8926-853b-423d-a8e3-c918431fd5ea', 'volume_name': 'volume-622f8926-853b-423d-a8e3-c918431fd5ea', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f817aa2-b32c-4438-a723-b16820d8c6c1 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (049d0280-c5c5-48a9-8f30-5ce7e82d3636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f817aa2-b32c-4438-a723-b16820d8c6c1 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (049d0280-c5c5-48a9-8f30-5ce7e82d3636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f817aa2-b32c-4438-a723-b16820d8c6c1 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eefead4-c257-4088-a10a-6e20af3644a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:32 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-8f817aa2-b32c-4438-a723-b16820d8c6c1 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Volume 622f8926-853b-423d-a8e3-c918431fd5ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-622f8926-853b-423d-a8e3-c918431fd5ea', 'volume_size': 1}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8f817aa2-b32c-4438-a723-b16820d8c6c1 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8f817aa2-b32c-4438-a723-b16820d8c6c1 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8f817aa2-b32c-4438-a723-b16820d8c6c1 tempest-CreateVolumesFromSnapshotTest-1116594186 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-304163535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=622f8926-853b-423d-a8e3-c918431fd5ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e274de80404f464c8ad70f5ff5e4d651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:32Z,use_quota=True,user_id='624813ec730b4de18df55083f18f6f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-8f817aa2-b32c-4438-a723-b16820d8c6c1 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Creating volume 622f8926-853b-423d-a8e3-c918431fd5ea {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8f817aa2-b32c-4438-a723-b16820d8c6c1 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8f817aa2-b32c-4438-a723-b16820d8c6c1 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8f817aa2-b32c-4438-a723-b16820d8c6c1 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8f817aa2-b32c-4438-a723-b16820d8c6c1 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8f817aa2-b32c-4438-a723-b16820d8c6c1 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8f817aa2-b32c-4438-a723-b16820d8c6c1 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:32:32 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-8f817aa2-b32c-4438-a723-b16820d8c6c1 tempest-CreateVolumesFromSnapshotTest-1116594186 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8f817aa2-b32c-4438-a723-b16820d8c6c1 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-622f8926-853b-423d-a8e3-c918431fd5ea 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:32 devstack sudo[88852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-622f8926-853b-423d-a8e3-c918431fd5ea 1073741824
Apr 02 10:32:32 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-044e9fd4-98b3-4b17-bd0b-1a907d88cc1f tempest-VolumesGetTest-761816182 None] Acquiring lock "cinder-758ee138-5b68-48f0-a71e-ad0f36dea823-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-bad3d518-7e8b-47a4-937c-b39696ef2a0f tempest-CreateVolumesFromSnapshotTest-1116594186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bad3d518-7e8b-47a4-937c-b39696ef2a0f tempest-CreateVolumesFromSnapshotTest-1116594186 None] Flow 'volume_create_manager' (a6114706-6d82-40b6-b587-f4aef5fbc57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bad3d518-7e8b-47a4-937c-b39696ef2a0f tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5e83a79-5852-482f-9c0c-c71b83a4ece6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-044e9fd4-98b3-4b17-bd0b-1a907d88cc1f tempest-VolumesGetTest-761816182 None] Lock "cinder-758ee138-5b68-48f0-a71e-ad0f36dea823-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bad3d518-7e8b-47a4-937c-b39696ef2a0f tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5e83a79-5852-482f-9c0c-c71b83a4ece6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1994604270',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0fbd0c4-00a8-42e2-a5c5-0bff4e79bf39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e274de80404f464c8ad70f5ff5e4d651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:33Z,use_quota=True,user_id='624813ec730b4de18df55083f18f6f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bad3d518-7e8b-47a4-937c-b39696ef2a0f tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e46424-5578-4e63-90dc-223744b427d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bad3d518-7e8b-47a4-937c-b39696ef2a0f tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e46424-5578-4e63-90dc-223744b427d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bad3d518-7e8b-47a4-937c-b39696ef2a0f tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1042e745-8c6b-42fb-96ae-aba212d0b104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bad3d518-7e8b-47a4-937c-b39696ef2a0f tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1042e745-8c6b-42fb-96ae-aba212d0b104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0fbd0c4-00a8-42e2-a5c5-0bff4e79bf39', 'volume_name': 'volume-a0fbd0c4-00a8-42e2-a5c5-0bff4e79bf39', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bad3d518-7e8b-47a4-937c-b39696ef2a0f tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b935492a-6f13-417d-a3f8-4e9067e97b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bad3d518-7e8b-47a4-937c-b39696ef2a0f tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b935492a-6f13-417d-a3f8-4e9067e97b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bad3d518-7e8b-47a4-937c-b39696ef2a0f tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85e07259-e0bb-4449-8e2b-068089b19c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:32 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-bad3d518-7e8b-47a4-937c-b39696ef2a0f tempest-CreateVolumesFromSnapshotTest-1116594186 None] Volume a0fbd0c4-00a8-42e2-a5c5-0bff4e79bf39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0fbd0c4-00a8-42e2-a5c5-0bff4e79bf39', 'volume_size': 1}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bad3d518-7e8b-47a4-937c-b39696ef2a0f tempest-CreateVolumesFromSnapshotTest-1116594186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-044e9fd4-98b3-4b17-bd0b-1a907d88cc1f tempest-VolumesGetTest-761816182 None] Acquiring lock "cinder-quobyte-758ee138-5b68-48f0-a71e-ad0f36dea823" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-044e9fd4-98b3-4b17-bd0b-1a907d88cc1f tempest-VolumesGetTest-761816182 None] Lock "cinder-quobyte-758ee138-5b68-48f0-a71e-ad0f36dea823" acquired by "delete_volume" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[409679ab-c2d3-4560-91aa-dcc4ad80409f]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-044e9fd4-98b3-4b17-bd0b-1a907d88cc1f tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-758ee138-5b68-48f0-a71e-ad0f36dea823 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b6938f4-3d92-49b2-9298-17fb05d2e89d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:32:32 devstack sudo[88854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-758ee138-5b68-48f0-a71e-ad0f36dea823
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-2b6938f4-3d92-49b2-9298-17fb05d2e89d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Flow 'volume_create_manager' (75da0db7-401d-492a-9685-0d84d837d32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:32:32 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-2b6938f4-3d92-49b2-9298-17fb05d2e89d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c4a3132-4d81-4f22-a526-4758d14d1b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-2b6938f4-3d92-49b2-9298-17fb05d2e89d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c4a3132-4d81-4f22-a526-4758d14d1b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1978928659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8210446-9ca5-40e0-9014-c9a03125901b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e274de80404f464c8ad70f5ff5e4d651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:33Z,use_quota=True,user_id='624813ec730b4de18df55083f18f6f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-2b6938f4-3d92-49b2-9298-17fb05d2e89d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fed08b9-cc57-40e5-be81-ccdb3883749e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-2b6938f4-3d92-49b2-9298-17fb05d2e89d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fed08b9-cc57-40e5-be81-ccdb3883749e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-2b6938f4-3d92-49b2-9298-17fb05d2e89d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1226290-28b4-43dc-8d4b-eb76bffa2c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-2b6938f4-3d92-49b2-9298-17fb05d2e89d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1226290-28b4-43dc-8d4b-eb76bffa2c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8210446-9ca5-40e0-9014-c9a03125901b', 'volume_name': 'volume-e8210446-9ca5-40e0-9014-c9a03125901b', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-2b6938f4-3d92-49b2-9298-17fb05d2e89d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34d12914-8267-495e-9565-65b2a22dbc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-2b6938f4-3d92-49b2-9298-17fb05d2e89d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34d12914-8267-495e-9565-65b2a22dbc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-2b6938f4-3d92-49b2-9298-17fb05d2e89d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df6c370a-28f0-40cb-a6ce-1d040e2e396d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:32 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-2b6938f4-3d92-49b2-9298-17fb05d2e89d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Volume e8210446-9ca5-40e0-9014-c9a03125901b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8210446-9ca5-40e0-9014-c9a03125901b', 'volume_size': 1}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-2b6938f4-3d92-49b2-9298-17fb05d2e89d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-de8378e6-32f6-421e-ac12-21061f09a160 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-de8378e6-32f6-421e-ac12-21061f09a160 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Flow 'volume_create_manager' (d5153c6a-96cd-4f63-b8d0-5ef892aa22c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:32:32 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-de8378e6-32f6-421e-ac12-21061f09a160 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81925ab0-6a7c-41c5-a964-8419e64adc05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-de8378e6-32f6-421e-ac12-21061f09a160 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81925ab0-6a7c-41c5-a964-8419e64adc05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-730511855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=518e6223-81af-44e3-bccb-699e62c312c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e274de80404f464c8ad70f5ff5e4d651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:33Z,use_quota=True,user_id='624813ec730b4de18df55083f18f6f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-de8378e6-32f6-421e-ac12-21061f09a160 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5b513b2-84b5-49d5-aa26-1bdcba674b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-de8378e6-32f6-421e-ac12-21061f09a160 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5b513b2-84b5-49d5-aa26-1bdcba674b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-de8378e6-32f6-421e-ac12-21061f09a160 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9867256d-cb40-4177-8a66-1627856636d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-de8378e6-32f6-421e-ac12-21061f09a160 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9867256d-cb40-4177-8a66-1627856636d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '518e6223-81af-44e3-bccb-699e62c312c6', 'volume_name': 'volume-518e6223-81af-44e3-bccb-699e62c312c6', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-de8378e6-32f6-421e-ac12-21061f09a160 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1beb20ef-b63a-46f7-a343-2cb5149b1cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-de8378e6-32f6-421e-ac12-21061f09a160 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1beb20ef-b63a-46f7-a343-2cb5149b1cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-de8378e6-32f6-421e-ac12-21061f09a160 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538dabb8-cc99-4ffc-81f3-a91c0d6d99e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:33 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-de8378e6-32f6-421e-ac12-21061f09a160 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Volume 518e6223-81af-44e3-bccb-699e62c312c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-518e6223-81af-44e3-bccb-699e62c312c6', 'volume_size': 1}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-de8378e6-32f6-421e-ac12-21061f09a160 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:33 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8f817aa2-b32c-4438-a723-b16820d8c6c1 tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-622f8926-853b-423d-a8e3-c918431fd5ea 1073741824" returned: 0 in 0.657s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8f817aa2-b32c-4438-a723-b16820d8c6c1 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-622f8926-853b-423d-a8e3-c918431fd5ea {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:33 devstack sudo[88859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-622f8926-853b-423d-a8e3-c918431fd5ea
Apr 02 10:32:33 devstack sudo[88859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-701bd838-573a-4248-95d4-e0108c1776f0 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-701bd838-573a-4248-95d4-e0108c1776f0 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Flow 'volume_create_manager' (6bccc26f-8035-45f4-91a5-6d2b1e769240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-701bd838-573a-4248-95d4-e0108c1776f0 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4706153b-3240-40da-820d-82021b2b53e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-701bd838-573a-4248-95d4-e0108c1776f0 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4706153b-3240-40da-820d-82021b2b53e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-371749743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=132dab09-812a-4926-a236-633b01405ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e274de80404f464c8ad70f5ff5e4d651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:33Z,use_quota=True,user_id='624813ec730b4de18df55083f18f6f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-701bd838-573a-4248-95d4-e0108c1776f0 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7907b511-4275-48c2-b482-db80917584ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-701bd838-573a-4248-95d4-e0108c1776f0 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7907b511-4275-48c2-b482-db80917584ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-701bd838-573a-4248-95d4-e0108c1776f0 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (108e6fa5-e389-46bb-9c60-76a4c96c05e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-701bd838-573a-4248-95d4-e0108c1776f0 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (108e6fa5-e389-46bb-9c60-76a4c96c05e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '132dab09-812a-4926-a236-633b01405ab5', 'volume_name': 'volume-132dab09-812a-4926-a236-633b01405ab5', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-701bd838-573a-4248-95d4-e0108c1776f0 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c5d97b-aacd-4d1e-8e56-7464bf9f03ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:33 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-701bd838-573a-4248-95d4-e0108c1776f0 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c5d97b-aacd-4d1e-8e56-7464bf9f03ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-701bd838-573a-4248-95d4-e0108c1776f0 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7650425-1c41-451a-9165-49943d6a15c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:33 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-701bd838-573a-4248-95d4-e0108c1776f0 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Volume 132dab09-812a-4926-a236-633b01405ab5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-132dab09-812a-4926-a236-633b01405ab5', 'volume_size': 1}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-701bd838-573a-4248-95d4-e0108c1776f0 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-044e9fd4-98b3-4b17-bd0b-1a907d88cc1f tempest-VolumesGetTest-761816182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-758ee138-5b68-48f0-a71e-ad0f36dea823" returned: 0 in 0.551s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-044e9fd4-98b3-4b17-bd0b-1a907d88cc1f tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-758ee138-5b68-48f0-a71e-ad0f36dea823 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:33 devstack sudo[88864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-758ee138-5b68-48f0-a71e-ad0f36dea823
Apr 02 10:32:33 devstack sudo[88864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:33 devstack sudo[88859]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8f817aa2-b32c-4438-a723-b16820d8c6c1 tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-622f8926-853b-423d-a8e3-c918431fd5ea" returned: 0 in 0.424s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8f817aa2-b32c-4438-a723-b16820d8c6c1 tempest-CreateVolumesFromSnapshotTest-1116594186 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8f817aa2-b32c-4438-a723-b16820d8c6c1 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bad3d518-7e8b-47a4-937c-b39696ef2a0f tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.871s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-bad3d518-7e8b-47a4-937c-b39696ef2a0f tempest-CreateVolumesFromSnapshotTest-1116594186 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1994604270',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0fbd0c4-00a8-42e2-a5c5-0bff4e79bf39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e274de80404f464c8ad70f5ff5e4d651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:33Z,use_quota=True,user_id='624813ec730b4de18df55083f18f6f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-bad3d518-7e8b-47a4-937c-b39696ef2a0f tempest-CreateVolumesFromSnapshotTest-1116594186 None] Creating volume a0fbd0c4-00a8-42e2-a5c5-0bff4e79bf39 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bad3d518-7e8b-47a4-937c-b39696ef2a0f tempest-CreateVolumesFromSnapshotTest-1116594186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bad3d518-7e8b-47a4-937c-b39696ef2a0f tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-bad3d518-7e8b-47a4-937c-b39696ef2a0f tempest-CreateVolumesFromSnapshotTest-1116594186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-bad3d518-7e8b-47a4-937c-b39696ef2a0f tempest-CreateVolumesFromSnapshotTest-1116594186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bad3d518-7e8b-47a4-937c-b39696ef2a0f tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-bad3d518-7e8b-47a4-937c-b39696ef2a0f tempest-CreateVolumesFromSnapshotTest-1116594186 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:32:33 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-bad3d518-7e8b-47a4-937c-b39696ef2a0f tempest-CreateVolumesFromSnapshotTest-1116594186 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bad3d518-7e8b-47a4-937c-b39696ef2a0f tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a0fbd0c4-00a8-42e2-a5c5-0bff4e79bf39 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:33 devstack sudo[88867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a0fbd0c4-00a8-42e2-a5c5-0bff4e79bf39 1073741824
Apr 02 10:32:33 devstack sudo[88867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f817aa2-b32c-4438-a723-b16820d8c6c1 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eefead4-c257-4088-a10a-6e20af3644a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-622f8926-853b-423d-a8e3-c918431fd5ea', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f817aa2-b32c-4438-a723-b16820d8c6c1 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b10a216d-4411-4b9c-aa4a-0ff5c135d809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:33 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-8f817aa2-b32c-4438-a723-b16820d8c6c1 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Volume volume-622f8926-853b-423d-a8e3-c918431fd5ea (622f8926-853b-423d-a8e3-c918431fd5ea): created successfully
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f817aa2-b32c-4438-a723-b16820d8c6c1 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b10a216d-4411-4b9c-aa4a-0ff5c135d809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f817aa2-b32c-4438-a723-b16820d8c6c1 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Flow 'volume_create_manager' (ecd1146a-797e-4c97-a3f6-341e4dda223e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:32:33 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-8f817aa2-b32c-4438-a723-b16820d8c6c1 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Created volume successfully.
Apr 02 10:32:33 devstack sudo[88864]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-044e9fd4-98b3-4b17-bd0b-1a907d88cc1f tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-758ee138-5b68-48f0-a71e-ad0f36dea823" returned: 0 in 0.446s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-044e9fd4-98b3-4b17-bd0b-1a907d88cc1f tempest-VolumesGetTest-761816182 None] Lock "cinder-quobyte-758ee138-5b68-48f0-a71e-ad0f36dea823" released by "delete_volume" :: held 1.022s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-044e9fd4-98b3-4b17-bd0b-1a907d88cc1f tempest-VolumesGetTest-761816182 None] Created reservations ['cdf9278a-b0dc-4705-84ec-098fe52dfa2c', 'a8254495-39d6-4dba-b988-53ac57390640', '8d55cbd0-947e-406e-9d64-fdb6d6e9eae6', '5a03ccfe-3386-4534-bd22-1c2ff23f8285'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-044e9fd4-98b3-4b17-bd0b-1a907d88cc1f tempest-VolumesGetTest-761816182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-044e9fd4-98b3-4b17-bd0b-1a907d88cc1f tempest-VolumesGetTest-761816182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-044e9fd4-98b3-4b17-bd0b-1a907d88cc1f tempest-VolumesGetTest-761816182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-044e9fd4-98b3-4b17-bd0b-1a907d88cc1f tempest-VolumesGetTest-761816182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-044e9fd4-98b3-4b17-bd0b-1a907d88cc1f tempest-VolumesGetTest-761816182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-044e9fd4-98b3-4b17-bd0b-1a907d88cc1f tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:33 devstack sudo[88870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:32:33 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:34 devstack sudo[88867]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bad3d518-7e8b-47a4-937c-b39696ef2a0f tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a0fbd0c4-00a8-42e2-a5c5-0bff4e79bf39 1073741824" returned: 0 in 0.482s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bad3d518-7e8b-47a4-937c-b39696ef2a0f tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a0fbd0c4-00a8-42e2-a5c5-0bff4e79bf39 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:34 devstack sudo[88875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a0fbd0c4-00a8-42e2-a5c5-0bff4e79bf39
Apr 02 10:32:34 devstack sudo[88875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:34 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-044e9fd4-98b3-4b17-bd0b-1a907d88cc1f tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.406s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:34 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-044e9fd4-98b3-4b17-bd0b-1a907d88cc1f tempest-VolumesGetTest-761816182 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:32:34 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-044e9fd4-98b3-4b17-bd0b-1a907d88cc1f tempest-VolumesGetTest-761816182 None] Deleted volume successfully.
Apr 02 10:32:34 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-044e9fd4-98b3-4b17-bd0b-1a907d88cc1f tempest-VolumesGetTest-761816182 None] Lock "cinder-758ee138-5b68-48f0-a71e-ad0f36dea823-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:34 devstack sudo[88875]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bad3d518-7e8b-47a4-937c-b39696ef2a0f tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a0fbd0c4-00a8-42e2-a5c5-0bff4e79bf39" returned: 0 in 0.394s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:34 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-bad3d518-7e8b-47a4-937c-b39696ef2a0f tempest-CreateVolumesFromSnapshotTest-1116594186 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:32:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bad3d518-7e8b-47a4-937c-b39696ef2a0f tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-2b6938f4-3d92-49b2-9298-17fb05d2e89d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.600s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:34 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-2b6938f4-3d92-49b2-9298-17fb05d2e89d tempest-CreateVolumesFromSnapshotTest-1116594186 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1978928659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8210446-9ca5-40e0-9014-c9a03125901b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e274de80404f464c8ad70f5ff5e4d651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:33Z,use_quota=True,user_id='624813ec730b4de18df55083f18f6f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:32:34 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-2b6938f4-3d92-49b2-9298-17fb05d2e89d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Creating volume e8210446-9ca5-40e0-9014-c9a03125901b {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:32:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-2b6938f4-3d92-49b2-9298-17fb05d2e89d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-2b6938f4-3d92-49b2-9298-17fb05d2e89d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:34 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-2b6938f4-3d92-49b2-9298-17fb05d2e89d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:32:34 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-2b6938f4-3d92-49b2-9298-17fb05d2e89d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:32:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-2b6938f4-3d92-49b2-9298-17fb05d2e89d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:34 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-2b6938f4-3d92-49b2-9298-17fb05d2e89d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:32:34 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-2b6938f4-3d92-49b2-9298-17fb05d2e89d tempest-CreateVolumesFromSnapshotTest-1116594186 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:32:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2b6938f4-3d92-49b2-9298-17fb05d2e89d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e8210446-9ca5-40e0-9014-c9a03125901b 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bad3d518-7e8b-47a4-937c-b39696ef2a0f tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85e07259-e0bb-4449-8e2b-068089b19c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0fbd0c4-00a8-42e2-a5c5-0bff4e79bf39', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:34 devstack sudo[88879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e8210446-9ca5-40e0-9014-c9a03125901b 1073741824
Apr 02 10:32:34 devstack sudo[88879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bad3d518-7e8b-47a4-937c-b39696ef2a0f tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (736855c7-3c81-4515-b75c-4f56d927aadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:34 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-bad3d518-7e8b-47a4-937c-b39696ef2a0f tempest-CreateVolumesFromSnapshotTest-1116594186 None] Volume volume-a0fbd0c4-00a8-42e2-a5c5-0bff4e79bf39 (a0fbd0c4-00a8-42e2-a5c5-0bff4e79bf39): created successfully
Apr 02 10:32:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bad3d518-7e8b-47a4-937c-b39696ef2a0f tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (736855c7-3c81-4515-b75c-4f56d927aadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bad3d518-7e8b-47a4-937c-b39696ef2a0f tempest-CreateVolumesFromSnapshotTest-1116594186 None] Flow 'volume_create_manager' (a6114706-6d82-40b6-b587-f4aef5fbc57d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:32:34 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-bad3d518-7e8b-47a4-937c-b39696ef2a0f tempest-CreateVolumesFromSnapshotTest-1116594186 None] Created volume successfully.
Apr 02 10:32:34 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-84c1c83d-c291-4127-82fe-1170a3f7e56f tempest-VolumesGetTest-761816182 None] Acquiring lock "cinder-9214e06c-361a-4c0f-8ebb-a056fb86e975-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:34 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-84c1c83d-c291-4127-82fe-1170a3f7e56f tempest-VolumesGetTest-761816182 None] Lock "cinder-9214e06c-361a-4c0f-8ebb-a056fb86e975-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:34 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-84c1c83d-c291-4127-82fe-1170a3f7e56f tempest-VolumesGetTest-761816182 None] Acquiring lock "cinder-quobyte-9214e06c-361a-4c0f-8ebb-a056fb86e975" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:34 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-84c1c83d-c291-4127-82fe-1170a3f7e56f tempest-VolumesGetTest-761816182 None] Lock "cinder-quobyte-9214e06c-361a-4c0f-8ebb-a056fb86e975" acquired by "delete_volume" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:34 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[22722fcc-c3be-4d5a-ba7e-22d746387cfb]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:32:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-84c1c83d-c291-4127-82fe-1170a3f7e56f tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:34 devstack sudo[88879]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2b6938f4-3d92-49b2-9298-17fb05d2e89d tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e8210446-9ca5-40e0-9014-c9a03125901b 1073741824" returned: 0 in 0.485s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:34 devstack sudo[88884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975
Apr 02 10:32:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2b6938f4-3d92-49b2-9298-17fb05d2e89d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e8210446-9ca5-40e0-9014-c9a03125901b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:34 devstack sudo[88884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:34 devstack sudo[88886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e8210446-9ca5-40e0-9014-c9a03125901b
Apr 02 10:32:34 devstack sudo[88886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:35 devstack sudo[88884]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-84c1c83d-c291-4127-82fe-1170a3f7e56f tempest-VolumesGetTest-761816182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975" returned: 0 in 0.505s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-84c1c83d-c291-4127-82fe-1170a3f7e56f tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:35 devstack sudo[88886]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2b6938f4-3d92-49b2-9298-17fb05d2e89d tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e8210446-9ca5-40e0-9014-c9a03125901b" returned: 0 in 0.435s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:35 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-2b6938f4-3d92-49b2-9298-17fb05d2e89d tempest-CreateVolumesFromSnapshotTest-1116594186 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:32:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-2b6938f4-3d92-49b2-9298-17fb05d2e89d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-de8378e6-32f6-421e-ac12-21061f09a160 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.356s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:35 devstack sudo[88892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975
Apr 02 10:32:35 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-de8378e6-32f6-421e-ac12-21061f09a160 tempest-CreateVolumesFromSnapshotTest-1116594186 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-730511855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=518e6223-81af-44e3-bccb-699e62c312c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e274de80404f464c8ad70f5ff5e4d651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:33Z,use_quota=True,user_id='624813ec730b4de18df55083f18f6f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:32:35 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-de8378e6-32f6-421e-ac12-21061f09a160 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Creating volume 518e6223-81af-44e3-bccb-699e62c312c6 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:32:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-de8378e6-32f6-421e-ac12-21061f09a160 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:35 devstack sudo[88892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-de8378e6-32f6-421e-ac12-21061f09a160 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:35 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-de8378e6-32f6-421e-ac12-21061f09a160 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:32:35 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-de8378e6-32f6-421e-ac12-21061f09a160 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:32:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-de8378e6-32f6-421e-ac12-21061f09a160 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:35 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-de8378e6-32f6-421e-ac12-21061f09a160 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:32:35 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-de8378e6-32f6-421e-ac12-21061f09a160 tempest-CreateVolumesFromSnapshotTest-1116594186 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:32:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-de8378e6-32f6-421e-ac12-21061f09a160 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-518e6223-81af-44e3-bccb-699e62c312c6 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:35 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-2b6938f4-3d92-49b2-9298-17fb05d2e89d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df6c370a-28f0-40cb-a6ce-1d040e2e396d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8210446-9ca5-40e0-9014-c9a03125901b', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:35 devstack sudo[88894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-518e6223-81af-44e3-bccb-699e62c312c6 1073741824
Apr 02 10:32:35 devstack sudo[88894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:35 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-2b6938f4-3d92-49b2-9298-17fb05d2e89d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb828851-8847-4b7c-bc6b-9ed5b5f894c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:35 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-2b6938f4-3d92-49b2-9298-17fb05d2e89d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Volume volume-e8210446-9ca5-40e0-9014-c9a03125901b (e8210446-9ca5-40e0-9014-c9a03125901b): created successfully
Apr 02 10:32:35 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-2b6938f4-3d92-49b2-9298-17fb05d2e89d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb828851-8847-4b7c-bc6b-9ed5b5f894c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:35 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-2b6938f4-3d92-49b2-9298-17fb05d2e89d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Flow 'volume_create_manager' (75da0db7-401d-492a-9685-0d84d837d32c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:32:35 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-2b6938f4-3d92-49b2-9298-17fb05d2e89d tempest-CreateVolumesFromSnapshotTest-1116594186 None] Created volume successfully.
Apr 02 10:32:35 devstack sudo[88892]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-84c1c83d-c291-4127-82fe-1170a3f7e56f tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9214e06c-361a-4c0f-8ebb-a056fb86e975" returned: 0 in 0.434s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:35 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-84c1c83d-c291-4127-82fe-1170a3f7e56f tempest-VolumesGetTest-761816182 None] Lock "cinder-quobyte-9214e06c-361a-4c0f-8ebb-a056fb86e975" released by "delete_volume" :: held 0.970s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:35 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-84c1c83d-c291-4127-82fe-1170a3f7e56f tempest-VolumesGetTest-761816182 None] Created reservations ['af246471-5abb-4761-afd0-db0d808e4319', '7ca1fa6e-58a0-4460-b62d-df241078b924', '572bc1d3-57c7-4cb0-ba8d-a2aabc00b3ea', 'c705c6a3-ea24-4a54-9041-949d1de7a078'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:32:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-84c1c83d-c291-4127-82fe-1170a3f7e56f tempest-VolumesGetTest-761816182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-84c1c83d-c291-4127-82fe-1170a3f7e56f tempest-VolumesGetTest-761816182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:35 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-84c1c83d-c291-4127-82fe-1170a3f7e56f tempest-VolumesGetTest-761816182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:32:35 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-84c1c83d-c291-4127-82fe-1170a3f7e56f tempest-VolumesGetTest-761816182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:32:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-84c1c83d-c291-4127-82fe-1170a3f7e56f tempest-VolumesGetTest-761816182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-84c1c83d-c291-4127-82fe-1170a3f7e56f tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:35 devstack sudo[88900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:32:35 devstack sudo[88900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:35 devstack sudo[88894]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-de8378e6-32f6-421e-ac12-21061f09a160 tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-518e6223-81af-44e3-bccb-699e62c312c6 1073741824" returned: 0 in 0.524s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-de8378e6-32f6-421e-ac12-21061f09a160 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-518e6223-81af-44e3-bccb-699e62c312c6 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:35 devstack sudo[88902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-518e6223-81af-44e3-bccb-699e62c312c6
Apr 02 10:32:35 devstack sudo[88902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:36 devstack sudo[88900]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-84c1c83d-c291-4127-82fe-1170a3f7e56f tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.388s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:36 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-84c1c83d-c291-4127-82fe-1170a3f7e56f tempest-VolumesGetTest-761816182 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:32:36 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-84c1c83d-c291-4127-82fe-1170a3f7e56f tempest-VolumesGetTest-761816182 None] Deleted volume successfully.
Apr 02 10:32:36 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-84c1c83d-c291-4127-82fe-1170a3f7e56f tempest-VolumesGetTest-761816182 None] Lock "cinder-9214e06c-361a-4c0f-8ebb-a056fb86e975-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:36 devstack sudo[88902]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-de8378e6-32f6-421e-ac12-21061f09a160 tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-518e6223-81af-44e3-bccb-699e62c312c6" returned: 0 in 0.406s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:36 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-de8378e6-32f6-421e-ac12-21061f09a160 tempest-CreateVolumesFromSnapshotTest-1116594186 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:32:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-de8378e6-32f6-421e-ac12-21061f09a160 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-701bd838-573a-4248-95d4-e0108c1776f0 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.115s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:36 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-701bd838-573a-4248-95d4-e0108c1776f0 tempest-CreateVolumesFromSnapshotTest-1116594186 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-371749743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=132dab09-812a-4926-a236-633b01405ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e274de80404f464c8ad70f5ff5e4d651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:33Z,use_quota=True,user_id='624813ec730b4de18df55083f18f6f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:32:36 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-701bd838-573a-4248-95d4-e0108c1776f0 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Creating volume 132dab09-812a-4926-a236-633b01405ab5 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:32:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-701bd838-573a-4248-95d4-e0108c1776f0 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-701bd838-573a-4248-95d4-e0108c1776f0 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:36 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-701bd838-573a-4248-95d4-e0108c1776f0 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:32:36 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-701bd838-573a-4248-95d4-e0108c1776f0 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:32:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-701bd838-573a-4248-95d4-e0108c1776f0 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:36 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-701bd838-573a-4248-95d4-e0108c1776f0 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:32:36 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-701bd838-573a-4248-95d4-e0108c1776f0 tempest-CreateVolumesFromSnapshotTest-1116594186 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:32:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-701bd838-573a-4248-95d4-e0108c1776f0 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-132dab09-812a-4926-a236-633b01405ab5 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-de8378e6-32f6-421e-ac12-21061f09a160 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538dabb8-cc99-4ffc-81f3-a91c0d6d99e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-518e6223-81af-44e3-bccb-699e62c312c6', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-de8378e6-32f6-421e-ac12-21061f09a160 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b4b4c29-ffcf-4872-8ec4-73f847321198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:36 devstack sudo[88906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-132dab09-812a-4926-a236-633b01405ab5 1073741824
Apr 02 10:32:36 devstack sudo[88906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:36 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-de8378e6-32f6-421e-ac12-21061f09a160 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Volume volume-518e6223-81af-44e3-bccb-699e62c312c6 (518e6223-81af-44e3-bccb-699e62c312c6): created successfully
Apr 02 10:32:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-de8378e6-32f6-421e-ac12-21061f09a160 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b4b4c29-ffcf-4872-8ec4-73f847321198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-de8378e6-32f6-421e-ac12-21061f09a160 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Flow 'volume_create_manager' (d5153c6a-96cd-4f63-b8d0-5ef892aa22c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:32:36 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-de8378e6-32f6-421e-ac12-21061f09a160 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Created volume successfully.
Apr 02 10:32:36 devstack sudo[88906]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-701bd838-573a-4248-95d4-e0108c1776f0 tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-132dab09-812a-4926-a236-633b01405ab5 1073741824" returned: 0 in 0.474s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-701bd838-573a-4248-95d4-e0108c1776f0 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-132dab09-812a-4926-a236-633b01405ab5 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:36 devstack sudo[88911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-132dab09-812a-4926-a236-633b01405ab5
Apr 02 10:32:36 devstack sudo[88911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:37 devstack sudo[88911]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-701bd838-573a-4248-95d4-e0108c1776f0 tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-132dab09-812a-4926-a236-633b01405ab5" returned: 0 in 0.432s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:37 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-701bd838-573a-4248-95d4-e0108c1776f0 tempest-CreateVolumesFromSnapshotTest-1116594186 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:32:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-701bd838-573a-4248-95d4-e0108c1776f0 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:37 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-701bd838-573a-4248-95d4-e0108c1776f0 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7650425-1c41-451a-9165-49943d6a15c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-132dab09-812a-4926-a236-633b01405ab5', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:37 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-701bd838-573a-4248-95d4-e0108c1776f0 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e0518d5-c8ea-4893-8dce-06c6b1ab6437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:37 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-701bd838-573a-4248-95d4-e0108c1776f0 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Volume volume-132dab09-812a-4926-a236-633b01405ab5 (132dab09-812a-4926-a236-633b01405ab5): created successfully
Apr 02 10:32:37 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-701bd838-573a-4248-95d4-e0108c1776f0 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e0518d5-c8ea-4893-8dce-06c6b1ab6437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:37 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-701bd838-573a-4248-95d4-e0108c1776f0 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Flow 'volume_create_manager' (6bccc26f-8035-45f4-91a5-6d2b1e769240) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:32:37 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-701bd838-573a-4248-95d4-e0108c1776f0 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Created volume successfully.
Apr 02 10:32:37 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:32:37 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Flow 'volume_create_manager' (1a5c3c1e-bed4-4b7c-a8a1-b5afd35a72d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:32:37 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c181a9c-92c5-477e-99a6-d0449c2d1647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:37 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c181a9c-92c5-477e-99a6-d0449c2d1647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1781189066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e9f3575-0b6b-44d8-8a73-55d51da307c4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a1ad18f9241c4a5a874bb3deb4504f14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:37Z,use_quota=True,user_id='8315f5fcca324498872ed34a5e8e6c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:37 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (152c00d6-627b-4b8d-9de8-9222eb5dab3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:37 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (152c00d6-627b-4b8d-9de8-9222eb5dab3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:37 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d71ebb48-7070-4e79-983f-7d1ffa69a6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:37 devstack cinder-volume[82102]: DEBUG cinder.image.glance [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Creating Keystone auth plugin from conf {{(pid=82102) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 02 10:32:37 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d71ebb48-7070-4e79-983f-7d1ffa69a6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2e9f3575-0b6b-44d8-8a73-55d51da307c4', 'volume_name': 'volume-2e9f3575-0b6b-44d8-8a73-55d51da307c4', 'volume_size': 1, 'image_id': '100d2cbf-7145-49cd-863b-c1e137045ce3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/100d2cbf-7145-49cd-863b-c1e137045ce3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e7bc1c1d4b5544979a3d9a5428cd3e5d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '100d2cbf-7145-49cd-863b-c1e137045ce3', 'created_at': datetime.datetime(2026, 4, 2, 8, 20, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 8, 20, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/100d2cbf-7145-49cd-863b-c1e137045ce3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6363437670>}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:37 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96de4e56-b9e9-4327-b9ae-d2d0b9bd1f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:37 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96de4e56-b9e9-4327-b9ae-d2d0b9bd1f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:37 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1b9edd3-66c8-448b-966d-aa8497629fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:37 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Volume 2e9f3575-0b6b-44d8-8a73-55d51da307c4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2e9f3575-0b6b-44d8-8a73-55d51da307c4', 'volume_size': 1, 'image_id': '100d2cbf-7145-49cd-863b-c1e137045ce3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/100d2cbf-7145-49cd-863b-c1e137045ce3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e7bc1c1d4b5544979a3d9a5428cd3e5d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '100d2cbf-7145-49cd-863b-c1e137045ce3', 'created_at': datetime.datetime(2026, 4, 2, 8, 20, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 8, 20, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/100d2cbf-7145-49cd-863b-c1e137045ce3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6363437670>}
Apr 02 10:32:37 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Trying to clone 2e9f3575-0b6b-44d8-8a73-55d51da307c4 from image 100d2cbf-7145-49cd-863b-c1e137045ce3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/100d2cbf-7145-49cd-863b-c1e137045ce3', 'metadata': {}}]). {{(pid=82102) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 02 10:32:37 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-86561144-c35b-4549-b320-13523fbb79ac tempest-CreateVolumesFromSnapshotTest-1116594186 None] Acquiring lock "cinder-132dab09-812a-4926-a236-633b01405ab5-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:37 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-86561144-c35b-4549-b320-13523fbb79ac tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "cinder-132dab09-812a-4926-a236-633b01405ab5-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:37 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-86561144-c35b-4549-b320-13523fbb79ac tempest-CreateVolumesFromSnapshotTest-1116594186 None] Acquiring lock "cinder-quobyte-132dab09-812a-4926-a236-633b01405ab5" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:37 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-86561144-c35b-4549-b320-13523fbb79ac tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "cinder-quobyte-132dab09-812a-4926-a236-633b01405ab5" acquired by "delete_volume" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:37 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c64e6f-fac6-4fe4-810b-8a68be99dde5]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:32:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-86561144-c35b-4549-b320-13523fbb79ac tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-132dab09-812a-4926-a236-633b01405ab5 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:37 devstack sudo[88914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-132dab09-812a-4926-a236-633b01405ab5
Apr 02 10:32:37 devstack sudo[88914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:37 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_hrm9trjrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82102) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 02 10:32:37 devstack cinder-volume[82102]: INFO cinder.image.image_utils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Image download 20.69 MB at 20.69 MB/s
Apr 02 10:32:37 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc9a8c4-ee26-4755-920a-e9e6cddcbbc8]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:32:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_hrm9trjrdevstack@QuobyteHD {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:37 devstack sudo[88917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_hrm9trjrdevstack@QuobyteHD
Apr 02 10:32:37 devstack sudo[88917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:38 devstack sudo[88914]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-86561144-c35b-4549-b320-13523fbb79ac tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-132dab09-812a-4926-a236-633b01405ab5" returned: 0 in 0.497s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-86561144-c35b-4549-b320-13523fbb79ac tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-132dab09-812a-4926-a236-633b01405ab5 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:38 devstack sudo[88922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-132dab09-812a-4926-a236-633b01405ab5
Apr 02 10:32:38 devstack sudo[88922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:38 devstack sudo[88917]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_hrm9trjrdevstack@QuobyteHD" returned: 0 in 0.466s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:38 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Temporary image 100d2cbf-7145-49cd-863b-c1e137045ce3 is fetched for user 8315f5fcca324498872ed34a5e8e6c4b. {{(pid=82102) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 02 10:32:38 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce0cf61-fbe3-4dd9-9e9a-bc65eb700a71]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:32:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_hrm9trjrdevstack@QuobyteHD {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:38 devstack sudo[88927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_hrm9trjrdevstack@QuobyteHD
Apr 02 10:32:38 devstack sudo[88927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:38 devstack sudo[88922]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-86561144-c35b-4549-b320-13523fbb79ac tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-132dab09-812a-4926-a236-633b01405ab5" returned: 0 in 0.419s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:38 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-86561144-c35b-4549-b320-13523fbb79ac tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "cinder-quobyte-132dab09-812a-4926-a236-633b01405ab5" released by "delete_volume" :: held 0.946s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:38 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-86561144-c35b-4549-b320-13523fbb79ac tempest-CreateVolumesFromSnapshotTest-1116594186 None] Created reservations ['47a4e17e-c079-45e4-aed9-75bad0ae0564', '3c7b982e-b8f2-4a70-9ecd-263d6351b463', 'afd0f886-6104-4a71-9e61-34904789354d', 'd49b2aab-4bc8-4a86-8e57-83306ba8a64b'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:32:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-86561144-c35b-4549-b320-13523fbb79ac tempest-CreateVolumesFromSnapshotTest-1116594186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-86561144-c35b-4549-b320-13523fbb79ac tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:38 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-86561144-c35b-4549-b320-13523fbb79ac tempest-CreateVolumesFromSnapshotTest-1116594186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:32:38 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-86561144-c35b-4549-b320-13523fbb79ac tempest-CreateVolumesFromSnapshotTest-1116594186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:32:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-86561144-c35b-4549-b320-13523fbb79ac tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-86561144-c35b-4549-b320-13523fbb79ac tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:38 devstack sudo[88930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:32:38 devstack sudo[88930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:38 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-862ccc7d-2547-473e-a0b6-ac63da5c51e2 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Acquiring lock "cinder-518e6223-81af-44e3-bccb-699e62c312c6-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:38 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-862ccc7d-2547-473e-a0b6-ac63da5c51e2 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "cinder-518e6223-81af-44e3-bccb-699e62c312c6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:38 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-862ccc7d-2547-473e-a0b6-ac63da5c51e2 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Acquiring lock "cinder-quobyte-518e6223-81af-44e3-bccb-699e62c312c6" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:38 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-862ccc7d-2547-473e-a0b6-ac63da5c51e2 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "cinder-quobyte-518e6223-81af-44e3-bccb-699e62c312c6" acquired by "delete_volume" :: waited 0.011s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:38 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9905ebdc-7910-4b3b-a585-2b7c104c3f5c]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:32:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-862ccc7d-2547-473e-a0b6-ac63da5c51e2 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-518e6223-81af-44e3-bccb-699e62c312c6 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:38 devstack sudo[88927]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_hrm9trjrdevstack@QuobyteHD" returned: 0 in 0.485s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:38 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1781189066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e9f3575-0b6b-44d8-8a73-55d51da307c4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a1ad18f9241c4a5a874bb3deb4504f14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:37Z,use_quota=True,user_id='8315f5fcca324498872ed34a5e8e6c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:32:38 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Creating volume 2e9f3575-0b6b-44d8-8a73-55d51da307c4 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:32:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:38 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:32:38 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:32:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:38 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:32:38 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:32:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2e9f3575-0b6b-44d8-8a73-55d51da307c4 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:38 devstack sudo[88936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2e9f3575-0b6b-44d8-8a73-55d51da307c4 1073741824
Apr 02 10:32:38 devstack sudo[88936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:38 devstack sudo[88935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-518e6223-81af-44e3-bccb-699e62c312c6
Apr 02 10:32:38 devstack sudo[88935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:39 devstack sudo[88930]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-86561144-c35b-4549-b320-13523fbb79ac tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.425s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:39 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-86561144-c35b-4549-b320-13523fbb79ac tempest-CreateVolumesFromSnapshotTest-1116594186 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:32:39 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-86561144-c35b-4549-b320-13523fbb79ac tempest-CreateVolumesFromSnapshotTest-1116594186 None] Deleted volume successfully.
Apr 02 10:32:39 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-86561144-c35b-4549-b320-13523fbb79ac tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "cinder-132dab09-812a-4926-a236-633b01405ab5-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:39 devstack sudo[88935]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-862ccc7d-2547-473e-a0b6-ac63da5c51e2 tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-518e6223-81af-44e3-bccb-699e62c312c6" returned: 0 in 0.475s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-862ccc7d-2547-473e-a0b6-ac63da5c51e2 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-518e6223-81af-44e3-bccb-699e62c312c6 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:39 devstack sudo[88946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-518e6223-81af-44e3-bccb-699e62c312c6
Apr 02 10:32:39 devstack sudo[88946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:39 devstack sudo[88936]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2e9f3575-0b6b-44d8-8a73-55d51da307c4 1073741824" returned: 0 in 0.478s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2e9f3575-0b6b-44d8-8a73-55d51da307c4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:39 devstack sudo[88948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2e9f3575-0b6b-44d8-8a73-55d51da307c4
Apr 02 10:32:39 devstack sudo[88948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:39 devstack sudo[88946]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-862ccc7d-2547-473e-a0b6-ac63da5c51e2 tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-518e6223-81af-44e3-bccb-699e62c312c6" returned: 0 in 0.409s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:39 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-862ccc7d-2547-473e-a0b6-ac63da5c51e2 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "cinder-quobyte-518e6223-81af-44e3-bccb-699e62c312c6" released by "delete_volume" :: held 0.908s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:39 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-862ccc7d-2547-473e-a0b6-ac63da5c51e2 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Created reservations ['5470d4e9-0fd3-4ca7-b2cd-333730337128', '30154692-bb59-4282-ae6f-cc22959dbae8', 'a846da56-239c-4824-8d3b-54be9757316d', '0b508490-974a-4e71-ba90-8ab4fa940e4f'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:32:39 devstack sudo[88948]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2e9f3575-0b6b-44d8-8a73-55d51da307c4" returned: 0 in 0.418s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:39 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:32:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:39 devstack cinder-volume[82102]: DEBUG cinder.volume.volume_utils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Attempting download of 100d2cbf-7145-49cd-863b-c1e137045ce3 ((None, [{'url': 'file:///opt/stack/data/glance/images/100d2cbf-7145-49cd-863b-c1e137045ce3', 'metadata': {}}])) to volume 2e9f3575-0b6b-44d8-8a73-55d51da307c4. {{(pid=82102) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 02 10:32:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-862ccc7d-2547-473e-a0b6-ac63da5c51e2 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-862ccc7d-2547-473e-a0b6-ac63da5c51e2 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:39 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-862ccc7d-2547-473e-a0b6-ac63da5c51e2 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:32:39 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-862ccc7d-2547-473e-a0b6-ac63da5c51e2 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:32:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-862ccc7d-2547-473e-a0b6-ac63da5c51e2 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-862ccc7d-2547-473e-a0b6-ac63da5c51e2 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:39 devstack sudo[88952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:32:39 devstack sudo[88952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:39 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f923e08d-6663-4688-91fb-62fe555d2319]: (4, 'raw') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:32:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_100d2cbf-7145-49cd-863b-c1e137045ce3_k2mhsg5y {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:39 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-be07ecd2-45ed-43ad-a062-76f4a33213ec tempest-CreateVolumesFromSnapshotTest-1116594186 None] Acquiring lock "cinder-e8210446-9ca5-40e0-9014-c9a03125901b-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:39 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-be07ecd2-45ed-43ad-a062-76f4a33213ec tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "cinder-e8210446-9ca5-40e0-9014-c9a03125901b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:39 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-be07ecd2-45ed-43ad-a062-76f4a33213ec tempest-CreateVolumesFromSnapshotTest-1116594186 None] Acquiring lock "cinder-quobyte-e8210446-9ca5-40e0-9014-c9a03125901b" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:40 devstack sudo[88954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_100d2cbf-7145-49cd-863b-c1e137045ce3_k2mhsg5y
Apr 02 10:32:40 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-be07ecd2-45ed-43ad-a062-76f4a33213ec tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "cinder-quobyte-e8210446-9ca5-40e0-9014-c9a03125901b" acquired by "delete_volume" :: waited 0.007s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:40 devstack sudo[88954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:40 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c86957-e602-44fb-8340-890bd6cb5cce]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:32:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-be07ecd2-45ed-43ad-a062-76f4a33213ec tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e8210446-9ca5-40e0-9014-c9a03125901b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:40 devstack sudo[88956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e8210446-9ca5-40e0-9014-c9a03125901b
Apr 02 10:32:40 devstack sudo[88956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:40 devstack sudo[88952]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-862ccc7d-2547-473e-a0b6-ac63da5c51e2 tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.437s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:40 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-862ccc7d-2547-473e-a0b6-ac63da5c51e2 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:32:40 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-862ccc7d-2547-473e-a0b6-ac63da5c51e2 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Deleted volume successfully.
Apr 02 10:32:40 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-862ccc7d-2547-473e-a0b6-ac63da5c51e2 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "cinder-518e6223-81af-44e3-bccb-699e62c312c6-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:40 devstack sudo[88954]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_100d2cbf-7145-49cd-863b-c1e137045ce3_k2mhsg5y" returned: 0 in 0.477s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_100d2cbf-7145-49cd-863b-c1e137045ce3_k2mhsg5y {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:40 devstack sudo[88961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_100d2cbf-7145-49cd-863b-c1e137045ce3_k2mhsg5y
Apr 02 10:32:40 devstack sudo[88961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:40 devstack sudo[88956]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-be07ecd2-45ed-43ad-a062-76f4a33213ec tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e8210446-9ca5-40e0-9014-c9a03125901b" returned: 0 in 0.481s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-be07ecd2-45ed-43ad-a062-76f4a33213ec tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e8210446-9ca5-40e0-9014-c9a03125901b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:40 devstack sudo[88966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e8210446-9ca5-40e0-9014-c9a03125901b
Apr 02 10:32:40 devstack sudo[88966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:40 devstack sudo[88961]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_100d2cbf-7145-49cd-863b-c1e137045ce3_k2mhsg5y" returned: 1 in 0.452s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_100d2cbf-7145-49cd-863b-c1e137045ce3_k2mhsg5y' failed. Not Retrying. {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 02 10:32:40 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb37fc6-e7b7-4e51-a9b0-70a73a8ce426]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:32:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_hrm9trjrdevstack@QuobyteHD {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:40 devstack sudo[88966]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-be07ecd2-45ed-43ad-a062-76f4a33213ec tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e8210446-9ca5-40e0-9014-c9a03125901b" returned: 0 in 0.381s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:40 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-be07ecd2-45ed-43ad-a062-76f4a33213ec tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "cinder-quobyte-e8210446-9ca5-40e0-9014-c9a03125901b" released by "delete_volume" :: held 0.901s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:40 devstack sudo[88977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_hrm9trjrdevstack@QuobyteHD
Apr 02 10:32:40 devstack sudo[88977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:40 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-be07ecd2-45ed-43ad-a062-76f4a33213ec tempest-CreateVolumesFromSnapshotTest-1116594186 None] Created reservations ['3f373713-d6a8-4186-a57e-4616f9a0ca06', 'af7d4cad-a81e-4d3c-8d82-ed11d5d6dd7e', 'deedd606-b6e7-4bc3-a1ab-9bdceb50696e', 'c00adc4a-5419-475c-8c6b-d2bdbd22ac03'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:32:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-be07ecd2-45ed-43ad-a062-76f4a33213ec tempest-CreateVolumesFromSnapshotTest-1116594186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-be07ecd2-45ed-43ad-a062-76f4a33213ec tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:40 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-be07ecd2-45ed-43ad-a062-76f4a33213ec tempest-CreateVolumesFromSnapshotTest-1116594186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:32:40 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-be07ecd2-45ed-43ad-a062-76f4a33213ec tempest-CreateVolumesFromSnapshotTest-1116594186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:32:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-be07ecd2-45ed-43ad-a062-76f4a33213ec tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-be07ecd2-45ed-43ad-a062-76f4a33213ec tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:40 devstack sudo[88980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:32:40 devstack sudo[88980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:41 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1f274e9f-9423-4685-95fa-700a21d2d9cf tempest-CreateVolumesFromSnapshotTest-1116594186 None] Acquiring lock "cinder-a0fbd0c4-00a8-42e2-a5c5-0bff4e79bf39-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:41 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1f274e9f-9423-4685-95fa-700a21d2d9cf tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "cinder-a0fbd0c4-00a8-42e2-a5c5-0bff4e79bf39-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:41 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1f274e9f-9423-4685-95fa-700a21d2d9cf tempest-CreateVolumesFromSnapshotTest-1116594186 None] Acquiring lock "cinder-quobyte-a0fbd0c4-00a8-42e2-a5c5-0bff4e79bf39" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:41 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1f274e9f-9423-4685-95fa-700a21d2d9cf tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "cinder-quobyte-a0fbd0c4-00a8-42e2-a5c5-0bff4e79bf39" acquired by "delete_volume" :: waited 0.019s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:41 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f998e38-36b6-42fe-b2e5-8a96389151ab]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:32:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1f274e9f-9423-4685-95fa-700a21d2d9cf tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a0fbd0c4-00a8-42e2-a5c5-0bff4e79bf39 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:41 devstack sudo[88982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a0fbd0c4-00a8-42e2-a5c5-0bff4e79bf39
Apr 02 10:32:41 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:41 devstack sudo[88977]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_hrm9trjrdevstack@QuobyteHD" returned: 0 in 0.458s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:41 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] 100d2cbf-7145-49cd-863b-c1e137045ce3 was qcow2, converting to raw {{(pid=82102) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 02 10:32:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_hrm9trjrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2e9f3575-0b6b-44d8-8a73-55d51da307c4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:41 devstack sudo[88988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_hrm9trjrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2e9f3575-0b6b-44d8-8a73-55d51da307c4
Apr 02 10:32:41 devstack sudo[88988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:41 devstack sudo[88980]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-be07ecd2-45ed-43ad-a062-76f4a33213ec tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.403s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:41 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-be07ecd2-45ed-43ad-a062-76f4a33213ec tempest-CreateVolumesFromSnapshotTest-1116594186 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:32:41 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-be07ecd2-45ed-43ad-a062-76f4a33213ec tempest-CreateVolumesFromSnapshotTest-1116594186 None] Deleted volume successfully.
Apr 02 10:32:41 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-be07ecd2-45ed-43ad-a062-76f4a33213ec tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "cinder-e8210446-9ca5-40e0-9014-c9a03125901b-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:41 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1f274e9f-9423-4685-95fa-700a21d2d9cf tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a0fbd0c4-00a8-42e2-a5c5-0bff4e79bf39" returned: 0 in 0.503s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1f274e9f-9423-4685-95fa-700a21d2d9cf tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a0fbd0c4-00a8-42e2-a5c5-0bff4e79bf39 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:41 devstack sudo[88996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a0fbd0c4-00a8-42e2-a5c5-0bff4e79bf39
Apr 02 10:32:41 devstack sudo[88996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:42 devstack sudo[88996]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1f274e9f-9423-4685-95fa-700a21d2d9cf tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a0fbd0c4-00a8-42e2-a5c5-0bff4e79bf39" returned: 0 in 0.456s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:42 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1f274e9f-9423-4685-95fa-700a21d2d9cf tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "cinder-quobyte-a0fbd0c4-00a8-42e2-a5c5-0bff4e79bf39" released by "delete_volume" :: held 0.979s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:42 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-1f274e9f-9423-4685-95fa-700a21d2d9cf tempest-CreateVolumesFromSnapshotTest-1116594186 None] Created reservations ['1bbb2d11-f693-45a5-a715-b765dbd9736c', 'ec9568f5-d0b6-4176-9f22-83e81525c0a0', '60406a14-7634-4970-b372-3587fdc41b82', '297f4356-e753-4105-9615-60cb75dc396b'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:32:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-1f274e9f-9423-4685-95fa-700a21d2d9cf tempest-CreateVolumesFromSnapshotTest-1116594186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-1f274e9f-9423-4685-95fa-700a21d2d9cf tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:42 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-1f274e9f-9423-4685-95fa-700a21d2d9cf tempest-CreateVolumesFromSnapshotTest-1116594186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:32:42 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-1f274e9f-9423-4685-95fa-700a21d2d9cf tempest-CreateVolumesFromSnapshotTest-1116594186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:32:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-1f274e9f-9423-4685-95fa-700a21d2d9cf tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1f274e9f-9423-4685-95fa-700a21d2d9cf tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:42 devstack sudo[88988]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_hrm9trjrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2e9f3575-0b6b-44d8-8a73-55d51da307c4" returned: 0 in 0.924s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:42 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_100d2cbf-7145-49cd-863b-c1e137045ce3_hrm9trjrdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2e9f3575-0b6b-44d8-8a73-55d51da307c4 {{(pid=82102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 02 10:32:42 devstack cinder-volume[82102]: INFO cinder.image.image_utils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Converted 112.00 MB image at 112.00 MB/s
Apr 02 10:32:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2e9f3575-0b6b-44d8-8a73-55d51da307c4 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:42 devstack sudo[89009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:32:42 devstack sudo[89009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:42 devstack sudo[89010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2e9f3575-0b6b-44d8-8a73-55d51da307c4 1G
Apr 02 10:32:42 devstack sudo[89010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:42 devstack sudo[89009]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1f274e9f-9423-4685-95fa-700a21d2d9cf tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.432s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:42 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-1f274e9f-9423-4685-95fa-700a21d2d9cf tempest-CreateVolumesFromSnapshotTest-1116594186 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:32:42 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-1f274e9f-9423-4685-95fa-700a21d2d9cf tempest-CreateVolumesFromSnapshotTest-1116594186 None] Deleted volume successfully.
Apr 02 10:32:42 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1f274e9f-9423-4685-95fa-700a21d2d9cf tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "cinder-a0fbd0c4-00a8-42e2-a5c5-0bff4e79bf39-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:42 devstack sudo[89010]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2e9f3575-0b6b-44d8-8a73-55d51da307c4 1G" returned: 0 in 0.459s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:42 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22259b5-524b-4b49-9375-ff62f3af6660]: (4, 'raw') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:32:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2e9f3575-0b6b-44d8-8a73-55d51da307c4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:42 devstack sudo[89017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2e9f3575-0b6b-44d8-8a73-55d51da307c4
Apr 02 10:32:42 devstack sudo[89017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:43 devstack sudo[89017]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2e9f3575-0b6b-44d8-8a73-55d51da307c4" returned: 0 in 0.446s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2e9f3575-0b6b-44d8-8a73-55d51da307c4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:43 devstack sudo[89021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2e9f3575-0b6b-44d8-8a73-55d51da307c4
Apr 02 10:32:43 devstack sudo[89021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:43 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1a2fcadc-4c96-4b3d-9528-d41ce3a40636 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Acquiring lock "cinder-622f8926-853b-423d-a8e3-c918431fd5ea-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:43 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1a2fcadc-4c96-4b3d-9528-d41ce3a40636 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "cinder-622f8926-853b-423d-a8e3-c918431fd5ea-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:43 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1a2fcadc-4c96-4b3d-9528-d41ce3a40636 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Acquiring lock "cinder-quobyte-622f8926-853b-423d-a8e3-c918431fd5ea" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:43 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1a2fcadc-4c96-4b3d-9528-d41ce3a40636 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "cinder-quobyte-622f8926-853b-423d-a8e3-c918431fd5ea" acquired by "delete_volume" :: waited 0.011s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:43 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7041dd54-98d5-4466-b973-7f2f3c98c9b3]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:32:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1a2fcadc-4c96-4b3d-9528-d41ce3a40636 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-622f8926-853b-423d-a8e3-c918431fd5ea {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:43 devstack sudo[89023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-622f8926-853b-423d-a8e3-c918431fd5ea
Apr 02 10:32:43 devstack sudo[89023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:43 devstack sudo[89021]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2e9f3575-0b6b-44d8-8a73-55d51da307c4" returned: 1 in 0.480s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2e9f3575-0b6b-44d8-8a73-55d51da307c4' failed. Not Retrying. {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 02 10:32:43 devstack cinder-volume[82102]: DEBUG cinder.volume.volume_utils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Downloaded image 100d2cbf-7145-49cd-863b-c1e137045ce3 ((None, [{'url': 'file:///opt/stack/data/glance/images/100d2cbf-7145-49cd-863b-c1e137045ce3', 'metadata': {}}])) to volume 2e9f3575-0b6b-44d8-8a73-55d51da307c4 successfully. {{(pid=82102) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 02 10:32:43 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Temporary image 100d2cbf-7145-49cd-863b-c1e137045ce3 for user 8315f5fcca324498872ed34a5e8e6c4b is deleted. {{(pid=82102) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 02 10:32:43 devstack cinder-volume[82102]: DEBUG cinder.volume.volume_utils [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Marking volume 2e9f3575-0b6b-44d8-8a73-55d51da307c4 as bootable. {{(pid=82102) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 02 10:32:43 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Copying metadata from image 100d2cbf-7145-49cd-863b-c1e137045ce3 to 2e9f3575-0b6b-44d8-8a73-55d51da307c4. {{(pid=82102) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 02 10:32:43 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Creating volume glance metadata for volume 2e9f3575-0b6b-44d8-8a73-55d51da307c4 backed by image 100d2cbf-7145-49cd-863b-c1e137045ce3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '100d2cbf-7145-49cd-863b-c1e137045ce3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82102) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 02 10:32:43 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1b9edd3-66c8-448b-966d-aa8497629fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e9f3575-0b6b-44d8-8a73-55d51da307c4', 'volume_size': 1, 'image_id': '100d2cbf-7145-49cd-863b-c1e137045ce3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/100d2cbf-7145-49cd-863b-c1e137045ce3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e7bc1c1d4b5544979a3d9a5428cd3e5d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '100d2cbf-7145-49cd-863b-c1e137045ce3', 'created_at': datetime.datetime(2026, 4, 2, 8, 20, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 2, 8, 20, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/100d2cbf-7145-49cd-863b-c1e137045ce3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6363437670>}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:43 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b73029fc-d2e6-4489-94f9-9fcf0cf5b23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:43 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Volume volume-2e9f3575-0b6b-44d8-8a73-55d51da307c4 (2e9f3575-0b6b-44d8-8a73-55d51da307c4): created successfully
Apr 02 10:32:43 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b73029fc-d2e6-4489-94f9-9fcf0cf5b23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:43 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Flow 'volume_create_manager' (1a5c3c1e-bed4-4b7c-a8a1-b5afd35a72d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:32:43 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-336362cf-0e71-488f-8d51-877b366e5596 tempest-VolumesGetTest-761816182 None] Created volume successfully.
Apr 02 10:32:43 devstack sudo[89023]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1a2fcadc-4c96-4b3d-9528-d41ce3a40636 tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-622f8926-853b-423d-a8e3-c918431fd5ea" returned: 0 in 0.489s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1a2fcadc-4c96-4b3d-9528-d41ce3a40636 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-622f8926-853b-423d-a8e3-c918431fd5ea {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:43 devstack sudo[89031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-622f8926-853b-423d-a8e3-c918431fd5ea
Apr 02 10:32:43 devstack sudo[89031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:44 devstack sudo[89031]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:44 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1a2fcadc-4c96-4b3d-9528-d41ce3a40636 tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-622f8926-853b-423d-a8e3-c918431fd5ea" returned: 0 in 0.379s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:44 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1a2fcadc-4c96-4b3d-9528-d41ce3a40636 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "cinder-quobyte-622f8926-853b-423d-a8e3-c918431fd5ea" released by "delete_volume" :: held 0.888s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:44 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-1a2fcadc-4c96-4b3d-9528-d41ce3a40636 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Created reservations ['b37d73cd-ab11-498e-8092-ef04b215e1f7', '6eefdc79-294d-466b-a443-ce13a366f2a6', '29f71360-748c-474f-b44c-bc423449f237', '850cf03e-bb2f-4ea1-96c1-87bb89dc986f'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:32:44 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-1a2fcadc-4c96-4b3d-9528-d41ce3a40636 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:44 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-1a2fcadc-4c96-4b3d-9528-d41ce3a40636 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:44 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-1a2fcadc-4c96-4b3d-9528-d41ce3a40636 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:32:44 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-1a2fcadc-4c96-4b3d-9528-d41ce3a40636 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:32:44 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-1a2fcadc-4c96-4b3d-9528-d41ce3a40636 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:44 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1a2fcadc-4c96-4b3d-9528-d41ce3a40636 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:44 devstack sudo[89034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:32:44 devstack sudo[89034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:44 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c9ea8b24-b1cf-420b-872e-b9c0d5925d0b tempest-CreateVolumesFromSnapshotTest-1116594186 None] Acquiring lock "cinder-4b8a5bca-2099-498a-9c2d-d2e28627edea-delete_snapshot" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:44 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c9ea8b24-b1cf-420b-872e-b9c0d5925d0b tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "cinder-4b8a5bca-2099-498a-9c2d-d2e28627edea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:44 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c9ea8b24-b1cf-420b-872e-b9c0d5925d0b tempest-CreateVolumesFromSnapshotTest-1116594186 None] Acquiring lock "cinder-quobyte-41c5c08f-05c5-4fc8-b123-1763cb222ccd" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:44 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c9ea8b24-b1cf-420b-872e-b9c0d5925d0b tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "cinder-quobyte-41c5c08f-05c5-4fc8-b123-1763cb222ccd" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:44 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c9ea8b24-b1cf-420b-872e-b9c0d5925d0b tempest-CreateVolumesFromSnapshotTest-1116594186 None] Acquiring lock "cinder-quobyte-4b8a5bca-2099-498a-9c2d-d2e28627edea" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:44 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c9ea8b24-b1cf-420b-872e-b9c0d5925d0b tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "cinder-quobyte-4b8a5bca-2099-498a-9c2d-d2e28627edea" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:44 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-c9ea8b24-b1cf-420b-872e-b9c0d5925d0b tempest-CreateVolumesFromSnapshotTest-1116594186 None] Deleting offline snapshot 4b8a5bca-2099-498a-9c2d-d2e28627edea of volume 41c5c08f-05c5-4fc8-b123-1763cb222ccd {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:32:44 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-c9ea8b24-b1cf-420b-872e-b9c0d5925d0b tempest-CreateVolumesFromSnapshotTest-1116594186 None] snapshot_file for this snap is: volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd.4b8a5bca-2099-498a-9c2d-d2e28627edea {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:32:44 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc48773-8599-4391-a194-3c086e4d30cd]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:32:44 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c9ea8b24-b1cf-420b-872e-b9c0d5925d0b tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd.4b8a5bca-2099-498a-9c2d-d2e28627edea {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:44 devstack sudo[89036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd.4b8a5bca-2099-498a-9c2d-d2e28627edea
Apr 02 10:32:44 devstack sudo[89036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:44 devstack sudo[89034]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:44 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1a2fcadc-4c96-4b3d-9528-d41ce3a40636 tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.418s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:44 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-1a2fcadc-4c96-4b3d-9528-d41ce3a40636 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:32:44 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-1a2fcadc-4c96-4b3d-9528-d41ce3a40636 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Deleted volume successfully.
Apr 02 10:32:44 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1a2fcadc-4c96-4b3d-9528-d41ce3a40636 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "cinder-622f8926-853b-423d-a8e3-c918431fd5ea-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:44 devstack sudo[89036]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:44 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c9ea8b24-b1cf-420b-872e-b9c0d5925d0b tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd.4b8a5bca-2099-498a-9c2d-d2e28627edea" returned: 0 in 0.493s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:44 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-c9ea8b24-b1cf-420b-872e-b9c0d5925d0b tempest-CreateVolumesFromSnapshotTest-1116594186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:32:44 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3a4153-51d6-412d-b177-e84a87f4b353]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:32:44 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c9ea8b24-b1cf-420b-872e-b9c0d5925d0b tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:45 devstack sudo[89042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd
Apr 02 10:32:45 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:45 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-4892aaf0-8982-49e6-827c-e55e63a7986b tempest-VolumesGetTest-761816182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:32:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-4892aaf0-8982-49e6-827c-e55e63a7986b tempest-VolumesGetTest-761816182 None] Flow 'volume_create_manager' (96f5a44a-51b3-4e8d-8e2d-93ac9fd73558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:32:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-4892aaf0-8982-49e6-827c-e55e63a7986b tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2852d8a-793a-4fd4-8aa0-3aae407eae83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-4892aaf0-8982-49e6-827c-e55e63a7986b tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2852d8a-793a-4fd4-8aa0-3aae407eae83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:32:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-371401001',display_name='tempest-VolumesGetTest-Volume-954694104',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dd12aae-7521-4553-8756-06ab9f74f46f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ad18f9241c4a5a874bb3deb4504f14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:45Z,use_quota=True,user_id='8315f5fcca324498872ed34a5e8e6c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-4892aaf0-8982-49e6-827c-e55e63a7986b tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a87a8f6-46cc-48e8-9b54-e4953c5caa00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-4892aaf0-8982-49e6-827c-e55e63a7986b tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a87a8f6-46cc-48e8-9b54-e4953c5caa00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-4892aaf0-8982-49e6-827c-e55e63a7986b tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1769a2d4-08cd-4394-a203-72c3e2d0cd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-4892aaf0-8982-49e6-827c-e55e63a7986b tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1769a2d4-08cd-4394-a203-72c3e2d0cd8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dd12aae-7521-4553-8756-06ab9f74f46f', 'volume_name': 'volume-2dd12aae-7521-4553-8756-06ab9f74f46f', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-4892aaf0-8982-49e6-827c-e55e63a7986b tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c4cc642-213c-41ba-966e-f93ce49da23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-4892aaf0-8982-49e6-827c-e55e63a7986b tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c4cc642-213c-41ba-966e-f93ce49da23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-4892aaf0-8982-49e6-827c-e55e63a7986b tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ad8fd8-8535-4a95-befd-2a275ec9efa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:45 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-4892aaf0-8982-49e6-827c-e55e63a7986b tempest-VolumesGetTest-761816182 None] Volume 2dd12aae-7521-4553-8756-06ab9f74f46f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dd12aae-7521-4553-8756-06ab9f74f46f', 'volume_size': 1}
Apr 02 10:32:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-4892aaf0-8982-49e6-827c-e55e63a7986b tempest-VolumesGetTest-761816182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-4892aaf0-8982-49e6-827c-e55e63a7986b tempest-VolumesGetTest-761816182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:45 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-4892aaf0-8982-49e6-827c-e55e63a7986b tempest-VolumesGetTest-761816182 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:32:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-371401001',display_name='tempest-VolumesGetTest-Volume-954694104',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dd12aae-7521-4553-8756-06ab9f74f46f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ad18f9241c4a5a874bb3deb4504f14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:32:45Z,use_quota=True,user_id='8315f5fcca324498872ed34a5e8e6c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:32:45 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-4892aaf0-8982-49e6-827c-e55e63a7986b tempest-VolumesGetTest-761816182 None] Creating volume 2dd12aae-7521-4553-8756-06ab9f74f46f {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:32:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-4892aaf0-8982-49e6-827c-e55e63a7986b tempest-VolumesGetTest-761816182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-4892aaf0-8982-49e6-827c-e55e63a7986b tempest-VolumesGetTest-761816182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:45 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-4892aaf0-8982-49e6-827c-e55e63a7986b tempest-VolumesGetTest-761816182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:32:45 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-4892aaf0-8982-49e6-827c-e55e63a7986b tempest-VolumesGetTest-761816182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:32:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-4892aaf0-8982-49e6-827c-e55e63a7986b tempest-VolumesGetTest-761816182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:45 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-4892aaf0-8982-49e6-827c-e55e63a7986b tempest-VolumesGetTest-761816182 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:32:45 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-4892aaf0-8982-49e6-827c-e55e63a7986b tempest-VolumesGetTest-761816182 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:32:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4892aaf0-8982-49e6-827c-e55e63a7986b tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2dd12aae-7521-4553-8756-06ab9f74f46f 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:45 devstack sudo[89044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2dd12aae-7521-4553-8756-06ab9f74f46f 1073741824
Apr 02 10:32:45 devstack sudo[89044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:45 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c9ea8b24-b1cf-420b-872e-b9c0d5925d0b tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd" returned: 0 in 0.539s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c9ea8b24-b1cf-420b-872e-b9c0d5925d0b tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd.4b8a5bca-2099-498a-9c2d-d2e28627edea {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:45 devstack sudo[89049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd.4b8a5bca-2099-498a-9c2d-d2e28627edea
Apr 02 10:32:45 devstack sudo[89049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:45 devstack sudo[89044]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4892aaf0-8982-49e6-827c-e55e63a7986b tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2dd12aae-7521-4553-8756-06ab9f74f46f 1073741824" returned: 0 in 0.479s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4892aaf0-8982-49e6-827c-e55e63a7986b tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2dd12aae-7521-4553-8756-06ab9f74f46f {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:45 devstack sudo[89054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2dd12aae-7521-4553-8756-06ab9f74f46f
Apr 02 10:32:45 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:45 devstack sudo[89049]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c9ea8b24-b1cf-420b-872e-b9c0d5925d0b tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd.4b8a5bca-2099-498a-9c2d-d2e28627edea" returned: 0 in 0.470s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c9ea8b24-b1cf-420b-872e-b9c0d5925d0b tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd.4b8a5bca-2099-498a-9c2d-d2e28627edea {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:45 devstack sudo[89059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd.4b8a5bca-2099-498a-9c2d-d2e28627edea
Apr 02 10:32:45 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:46 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:46 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4892aaf0-8982-49e6-827c-e55e63a7986b tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2dd12aae-7521-4553-8756-06ab9f74f46f" returned: 0 in 0.464s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:46 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-4892aaf0-8982-49e6-827c-e55e63a7986b tempest-VolumesGetTest-761816182 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:32:46 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-4892aaf0-8982-49e6-827c-e55e63a7986b tempest-VolumesGetTest-761816182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:46 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-4892aaf0-8982-49e6-827c-e55e63a7986b tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ad8fd8-8535-4a95-befd-2a275ec9efa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dd12aae-7521-4553-8756-06ab9f74f46f', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:46 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-4892aaf0-8982-49e6-827c-e55e63a7986b tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (080ea21e-0069-445f-81cd-d42cb2922ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:32:46 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-4892aaf0-8982-49e6-827c-e55e63a7986b tempest-VolumesGetTest-761816182 None] Volume volume-2dd12aae-7521-4553-8756-06ab9f74f46f (2dd12aae-7521-4553-8756-06ab9f74f46f): created successfully
Apr 02 10:32:46 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-4892aaf0-8982-49e6-827c-e55e63a7986b tempest-VolumesGetTest-761816182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (080ea21e-0069-445f-81cd-d42cb2922ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:32:46 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-4892aaf0-8982-49e6-827c-e55e63a7986b tempest-VolumesGetTest-761816182 None] Flow 'volume_create_manager' (96f5a44a-51b3-4e8d-8e2d-93ac9fd73558) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:32:46 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-4892aaf0-8982-49e6-827c-e55e63a7986b tempest-VolumesGetTest-761816182 None] Created volume successfully.
Apr 02 10:32:46 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:46 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c9ea8b24-b1cf-420b-872e-b9c0d5925d0b tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd.4b8a5bca-2099-498a-9c2d-d2e28627edea" returned: 0 in 0.431s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:46 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c9ea8b24-b1cf-420b-872e-b9c0d5925d0b tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "cinder-quobyte-4b8a5bca-2099-498a-9c2d-d2e28627edea" released by "_delete_snapshot" :: held 1.996s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:46 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c9ea8b24-b1cf-420b-872e-b9c0d5925d0b tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "cinder-quobyte-41c5c08f-05c5-4fc8-b123-1763cb222ccd" released by "delete_snapshot" :: held 2.010s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:46 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-c9ea8b24-b1cf-420b-872e-b9c0d5925d0b tempest-CreateVolumesFromSnapshotTest-1116594186 None] Created reservations ['6c014954-645e-40a8-b6b0-770d58a7c4f5', '468f1510-094d-4e09-a441-f52610119be1', '15eefec2-34fc-4e92-9811-801e5a459353', 'f519e103-3c64-49fe-8230-9fb7806e2c50'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:32:46 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-c9ea8b24-b1cf-420b-872e-b9c0d5925d0b tempest-CreateVolumesFromSnapshotTest-1116594186 None] Delete snapshot completed successfully.
Apr 02 10:32:46 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c9ea8b24-b1cf-420b-872e-b9c0d5925d0b tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "cinder-4b8a5bca-2099-498a-9c2d-d2e28627edea-delete_snapshot" released by "delete_snapshot" :: held 2.099s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:47 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-35fb183f-36c9-4ec4-baca-64b244a74ddb tempest-VolumesGetTest-761816182 None] Acquiring lock "cinder-2dd12aae-7521-4553-8756-06ab9f74f46f-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:47 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-35fb183f-36c9-4ec4-baca-64b244a74ddb tempest-VolumesGetTest-761816182 None] Lock "cinder-2dd12aae-7521-4553-8756-06ab9f74f46f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:47 devstack cinder-volume[82102]: DEBUG dbcounter [-] [82102] Writing DB stats cinder:UPDATE=193,cinder:SELECT=155,cinder:DELETE=12,cinder:INSERT=57 {{(pid=82102) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 02 10:32:47 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-35fb183f-36c9-4ec4-baca-64b244a74ddb tempest-VolumesGetTest-761816182 None] Acquiring lock "cinder-quobyte-2dd12aae-7521-4553-8756-06ab9f74f46f" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:47 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-35fb183f-36c9-4ec4-baca-64b244a74ddb tempest-VolumesGetTest-761816182 None] Lock "cinder-quobyte-2dd12aae-7521-4553-8756-06ab9f74f46f" acquired by "delete_volume" :: waited 0.021s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:47 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b762ba-5c1b-4314-9e17-58ce461e959d]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:32:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-35fb183f-36c9-4ec4-baca-64b244a74ddb tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2dd12aae-7521-4553-8756-06ab9f74f46f {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:47 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-73f401c0-2198-4bea-95ad-b6aa2f1905d7 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Acquiring lock "cinder-41c5c08f-05c5-4fc8-b123-1763cb222ccd-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:47 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-73f401c0-2198-4bea-95ad-b6aa2f1905d7 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "cinder-41c5c08f-05c5-4fc8-b123-1763cb222ccd-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:47 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-73f401c0-2198-4bea-95ad-b6aa2f1905d7 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Acquiring lock "cinder-quobyte-41c5c08f-05c5-4fc8-b123-1763cb222ccd" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:47 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-73f401c0-2198-4bea-95ad-b6aa2f1905d7 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "cinder-quobyte-41c5c08f-05c5-4fc8-b123-1763cb222ccd" acquired by "delete_volume" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:47 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0999a76d-b6f2-447f-a2df-09548413b6f5]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:32:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-73f401c0-2198-4bea-95ad-b6aa2f1905d7 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:47 devstack sudo[89063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2dd12aae-7521-4553-8756-06ab9f74f46f
Apr 02 10:32:47 devstack sudo[89063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:47 devstack sudo[89064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd
Apr 02 10:32:47 devstack sudo[89064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:48 devstack sudo[89063]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-35fb183f-36c9-4ec4-baca-64b244a74ddb tempest-VolumesGetTest-761816182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2dd12aae-7521-4553-8756-06ab9f74f46f" returned: 0 in 0.473s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-35fb183f-36c9-4ec4-baca-64b244a74ddb tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2dd12aae-7521-4553-8756-06ab9f74f46f {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:48 devstack sudo[89070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2dd12aae-7521-4553-8756-06ab9f74f46f
Apr 02 10:32:48 devstack sudo[89070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:48 devstack sudo[89064]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-73f401c0-2198-4bea-95ad-b6aa2f1905d7 tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd" returned: 0 in 0.555s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-73f401c0-2198-4bea-95ad-b6aa2f1905d7 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:48 devstack sudo[89107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd
Apr 02 10:32:48 devstack sudo[89107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:48 devstack sudo[89070]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-35fb183f-36c9-4ec4-baca-64b244a74ddb tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2dd12aae-7521-4553-8756-06ab9f74f46f" returned: 0 in 0.416s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:48 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-35fb183f-36c9-4ec4-baca-64b244a74ddb tempest-VolumesGetTest-761816182 None] Lock "cinder-quobyte-2dd12aae-7521-4553-8756-06ab9f74f46f" released by "delete_volume" :: held 0.915s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:48 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-35fb183f-36c9-4ec4-baca-64b244a74ddb tempest-VolumesGetTest-761816182 None] Created reservations ['61bb9949-0c9f-4ece-8ac1-ae2f7ad8c131', '2c2299a0-d602-42dc-921c-32cd53346539', 'cba7f0e8-9605-48e2-ae33-e8d47cb7f37d', '51b49844-e470-4587-9a91-dfbba8432fea'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:32:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-35fb183f-36c9-4ec4-baca-64b244a74ddb tempest-VolumesGetTest-761816182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-35fb183f-36c9-4ec4-baca-64b244a74ddb tempest-VolumesGetTest-761816182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:48 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-35fb183f-36c9-4ec4-baca-64b244a74ddb tempest-VolumesGetTest-761816182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:32:48 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-35fb183f-36c9-4ec4-baca-64b244a74ddb tempest-VolumesGetTest-761816182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:32:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-35fb183f-36c9-4ec4-baca-64b244a74ddb tempest-VolumesGetTest-761816182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-35fb183f-36c9-4ec4-baca-64b244a74ddb tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:48 devstack sudo[89112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:32:48 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:48 devstack sudo[89107]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:48 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-b56b7296-0564-4a6e-9a99-9f6d6490dd08 tempest-VolumesGetTest-761816182 None] Acquiring lock "cinder-2e9f3575-0b6b-44d8-8a73-55d51da307c4-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-73f401c0-2198-4bea-95ad-b6aa2f1905d7 tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-41c5c08f-05c5-4fc8-b123-1763cb222ccd" returned: 0 in 0.483s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:48 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-73f401c0-2198-4bea-95ad-b6aa2f1905d7 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "cinder-quobyte-41c5c08f-05c5-4fc8-b123-1763cb222ccd" released by "delete_volume" :: held 1.080s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:48 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-b56b7296-0564-4a6e-9a99-9f6d6490dd08 tempest-VolumesGetTest-761816182 None] Lock "cinder-2e9f3575-0b6b-44d8-8a73-55d51da307c4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:48 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-b56b7296-0564-4a6e-9a99-9f6d6490dd08 tempest-VolumesGetTest-761816182 None] Acquiring lock "cinder-quobyte-2e9f3575-0b6b-44d8-8a73-55d51da307c4" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:32:48 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-73f401c0-2198-4bea-95ad-b6aa2f1905d7 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Created reservations ['c8d61beb-640f-4bee-acba-b2b92ea9e0ca', '2ba6f4cf-9c1c-4015-b29c-20df50d44144', 'd4946bed-eb88-451c-bdac-7091d7617053', '6476beab-b632-4b16-98ad-659b8bf9f265'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:32:48 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-b56b7296-0564-4a6e-9a99-9f6d6490dd08 tempest-VolumesGetTest-761816182 None] Lock "cinder-quobyte-2e9f3575-0b6b-44d8-8a73-55d51da307c4" acquired by "delete_volume" :: waited 0.029s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:32:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-73f401c0-2198-4bea-95ad-b6aa2f1905d7 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-73f401c0-2198-4bea-95ad-b6aa2f1905d7 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:48 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-73f401c0-2198-4bea-95ad-b6aa2f1905d7 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:32:48 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-73f401c0-2198-4bea-95ad-b6aa2f1905d7 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:32:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-73f401c0-2198-4bea-95ad-b6aa2f1905d7 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-73f401c0-2198-4bea-95ad-b6aa2f1905d7 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:48 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[941bfd76-0068-4898-abe3-066e58256b0c]: (4, 'raw') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:32:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b56b7296-0564-4a6e-9a99-9f6d6490dd08 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2e9f3575-0b6b-44d8-8a73-55d51da307c4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:48 devstack sudo[89115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:32:48 devstack sudo[89115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:48 devstack sudo[89116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2e9f3575-0b6b-44d8-8a73-55d51da307c4
Apr 02 10:32:48 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:49 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-35fb183f-36c9-4ec4-baca-64b244a74ddb tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.461s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:49 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-35fb183f-36c9-4ec4-baca-64b244a74ddb tempest-VolumesGetTest-761816182 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:32:49 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-35fb183f-36c9-4ec4-baca-64b244a74ddb tempest-VolumesGetTest-761816182 None] Deleted volume successfully.
Apr 02 10:32:49 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-35fb183f-36c9-4ec4-baca-64b244a74ddb tempest-VolumesGetTest-761816182 None] Lock "cinder-2dd12aae-7521-4553-8756-06ab9f74f46f-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:49 devstack sudo[89115]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-73f401c0-2198-4bea-95ad-b6aa2f1905d7 tempest-CreateVolumesFromSnapshotTest-1116594186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.408s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:49 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-73f401c0-2198-4bea-95ad-b6aa2f1905d7 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:32:49 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-73f401c0-2198-4bea-95ad-b6aa2f1905d7 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Deleted volume successfully.
Apr 02 10:32:49 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-73f401c0-2198-4bea-95ad-b6aa2f1905d7 tempest-CreateVolumesFromSnapshotTest-1116594186 None] Lock "cinder-41c5c08f-05c5-4fc8-b123-1763cb222ccd-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:49 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b56b7296-0564-4a6e-9a99-9f6d6490dd08 tempest-VolumesGetTest-761816182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2e9f3575-0b6b-44d8-8a73-55d51da307c4" returned: 0 in 0.480s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b56b7296-0564-4a6e-9a99-9f6d6490dd08 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2e9f3575-0b6b-44d8-8a73-55d51da307c4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:49 devstack sudo[89123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2e9f3575-0b6b-44d8-8a73-55d51da307c4
Apr 02 10:32:49 devstack sudo[89123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:49 devstack sudo[89123]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b56b7296-0564-4a6e-9a99-9f6d6490dd08 tempest-VolumesGetTest-761816182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2e9f3575-0b6b-44d8-8a73-55d51da307c4" returned: 1 in 0.477s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b56b7296-0564-4a6e-9a99-9f6d6490dd08 tempest-VolumesGetTest-761816182 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2e9f3575-0b6b-44d8-8a73-55d51da307c4' failed. Not Retrying. {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 02 10:32:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b56b7296-0564-4a6e-9a99-9f6d6490dd08 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2e9f3575-0b6b-44d8-8a73-55d51da307c4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:49 devstack sudo[89128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2e9f3575-0b6b-44d8-8a73-55d51da307c4
Apr 02 10:32:49 devstack sudo[89128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:50 devstack sudo[89128]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b56b7296-0564-4a6e-9a99-9f6d6490dd08 tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-2e9f3575-0b6b-44d8-8a73-55d51da307c4" returned: 0 in 0.486s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:50 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-b56b7296-0564-4a6e-9a99-9f6d6490dd08 tempest-VolumesGetTest-761816182 None] Lock "cinder-quobyte-2e9f3575-0b6b-44d8-8a73-55d51da307c4" released by "delete_volume" :: held 1.502s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:32:50 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-b56b7296-0564-4a6e-9a99-9f6d6490dd08 tempest-VolumesGetTest-761816182 None] Created reservations ['faaea4e7-620c-432c-bd82-63abfb951470', '3016433d-0178-4243-85e1-110e4d8743d9', 'ab08d837-a361-4989-9654-c8894aa9d148', 'd9b6b633-d4b5-468b-baf9-597d30a9487c'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:32:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-b56b7296-0564-4a6e-9a99-9f6d6490dd08 tempest-VolumesGetTest-761816182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:32:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-b56b7296-0564-4a6e-9a99-9f6d6490dd08 tempest-VolumesGetTest-761816182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:32:50 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-b56b7296-0564-4a6e-9a99-9f6d6490dd08 tempest-VolumesGetTest-761816182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:32:50 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-b56b7296-0564-4a6e-9a99-9f6d6490dd08 tempest-VolumesGetTest-761816182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:32:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-b56b7296-0564-4a6e-9a99-9f6d6490dd08 tempest-VolumesGetTest-761816182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:32:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b56b7296-0564-4a6e-9a99-9f6d6490dd08 tempest-VolumesGetTest-761816182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:32:50 devstack sudo[89132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:32:50 devstack sudo[89132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:32:50 devstack sudo[89132]: pam_unix(sudo:session): session closed for user root
Apr 02 10:32:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b56b7296-0564-4a6e-9a99-9f6d6490dd08 tempest-VolumesGetTest-761816182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.505s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:32:50 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-b56b7296-0564-4a6e-9a99-9f6d6490dd08 tempest-VolumesGetTest-761816182 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:32:50 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-b56b7296-0564-4a6e-9a99-9f6d6490dd08 tempest-VolumesGetTest-761816182 None] Deleted volume successfully.
Apr 02 10:32:50 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-b56b7296-0564-4a6e-9a99-9f6d6490dd08 tempest-VolumesGetTest-761816182 None] Lock "cinder-2e9f3575-0b6b-44d8-8a73-55d51da307c4-delete_volume" released by "delete_volume" :: held 2.211s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:33:00 devstack cinder-volume[82102]: DEBUG dbcounter [-] [82102] Writing DB stats cinder:SELECT=19,cinder:INSERT=10,cinder:UPDATE=22,cinder:DELETE=1 {{(pid=82102) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 02 10:33:00 devstack cinder-volume[82102]: DEBUG dbcounter [-] [82102] Writing DB stats cinder:INSERT=48,cinder:UPDATE=193,cinder:SELECT=127,cinder:DELETE=20 {{(pid=82102) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 02 10:33:01 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f66c110-7f77-409e-9642-200c7bcb90b9 tempest-VolumesSnapshotTestJSON-821295557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:33:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f66c110-7f77-409e-9642-200c7bcb90b9 tempest-VolumesSnapshotTestJSON-821295557 None] Flow 'volume_create_manager' (baf5145b-69ce-4f1b-8c13-b9c0076661a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:33:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f66c110-7f77-409e-9642-200c7bcb90b9 tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f24f7fd-a57a-49b9-80bd-15399561d072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f66c110-7f77-409e-9642-200c7bcb90b9 tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f24f7fd-a57a-49b9-80bd-15399561d072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-121544319',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9be83004-7563-4823-a6bd-bff887626070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8924dff136241a2836da95789bd4859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:33:01Z,use_quota=True,user_id='9af7926171e44d8788c8a5dfb8ac1f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f66c110-7f77-409e-9642-200c7bcb90b9 tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d004d96-d3d3-49ac-a20c-6ed34924eb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f66c110-7f77-409e-9642-200c7bcb90b9 tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d004d96-d3d3-49ac-a20c-6ed34924eb75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f66c110-7f77-409e-9642-200c7bcb90b9 tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2e5b36b-1705-4d81-804b-0c1d5ff61e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f66c110-7f77-409e-9642-200c7bcb90b9 tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2e5b36b-1705-4d81-804b-0c1d5ff61e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9be83004-7563-4823-a6bd-bff887626070', 'volume_name': 'volume-9be83004-7563-4823-a6bd-bff887626070', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f66c110-7f77-409e-9642-200c7bcb90b9 tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09858cfa-395b-4efb-a895-b32da3cb12b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f66c110-7f77-409e-9642-200c7bcb90b9 tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09858cfa-395b-4efb-a895-b32da3cb12b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f66c110-7f77-409e-9642-200c7bcb90b9 tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c0f1c4c-c0ac-4789-ad82-c2c1fa5a1e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:01 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-8f66c110-7f77-409e-9642-200c7bcb90b9 tempest-VolumesSnapshotTestJSON-821295557 None] Volume 9be83004-7563-4823-a6bd-bff887626070: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9be83004-7563-4823-a6bd-bff887626070', 'volume_size': 1}
Apr 02 10:33:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8f66c110-7f77-409e-9642-200c7bcb90b9 tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:33:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8f66c110-7f77-409e-9642-200c7bcb90b9 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:33:01 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8f66c110-7f77-409e-9642-200c7bcb90b9 tempest-VolumesSnapshotTestJSON-821295557 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-121544319',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9be83004-7563-4823-a6bd-bff887626070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8924dff136241a2836da95789bd4859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:33:01Z,use_quota=True,user_id='9af7926171e44d8788c8a5dfb8ac1f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:33:01 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-8f66c110-7f77-409e-9642-200c7bcb90b9 tempest-VolumesSnapshotTestJSON-821295557 None] Creating volume 9be83004-7563-4823-a6bd-bff887626070 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:33:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8f66c110-7f77-409e-9642-200c7bcb90b9 tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:33:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8f66c110-7f77-409e-9642-200c7bcb90b9 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:33:01 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8f66c110-7f77-409e-9642-200c7bcb90b9 tempest-VolumesSnapshotTestJSON-821295557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:33:01 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8f66c110-7f77-409e-9642-200c7bcb90b9 tempest-VolumesSnapshotTestJSON-821295557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:33:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8f66c110-7f77-409e-9642-200c7bcb90b9 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:33:01 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8f66c110-7f77-409e-9642-200c7bcb90b9 tempest-VolumesSnapshotTestJSON-821295557 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:33:01 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-8f66c110-7f77-409e-9642-200c7bcb90b9 tempest-VolumesSnapshotTestJSON-821295557 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:33:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8f66c110-7f77-409e-9642-200c7bcb90b9 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:01 devstack sudo[89137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070 1073741824
Apr 02 10:33:01 devstack sudo[89137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:02 devstack sudo[89137]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8f66c110-7f77-409e-9642-200c7bcb90b9 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070 1073741824" returned: 0 in 0.648s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8f66c110-7f77-409e-9642-200c7bcb90b9 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:02 devstack sudo[89142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070
Apr 02 10:33:02 devstack sudo[89142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:02 devstack sudo[89142]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8f66c110-7f77-409e-9642-200c7bcb90b9 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070" returned: 0 in 0.494s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:02 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8f66c110-7f77-409e-9642-200c7bcb90b9 tempest-VolumesSnapshotTestJSON-821295557 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:33:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8f66c110-7f77-409e-9642-200c7bcb90b9 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:33:02 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f66c110-7f77-409e-9642-200c7bcb90b9 tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c0f1c4c-c0ac-4789-ad82-c2c1fa5a1e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9be83004-7563-4823-a6bd-bff887626070', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:02 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f66c110-7f77-409e-9642-200c7bcb90b9 tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cfa7dc0-35e5-4e35-bbeb-6ad7dad979e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:02 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-8f66c110-7f77-409e-9642-200c7bcb90b9 tempest-VolumesSnapshotTestJSON-821295557 None] Volume volume-9be83004-7563-4823-a6bd-bff887626070 (9be83004-7563-4823-a6bd-bff887626070): created successfully
Apr 02 10:33:02 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f66c110-7f77-409e-9642-200c7bcb90b9 tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cfa7dc0-35e5-4e35-bbeb-6ad7dad979e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:02 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8f66c110-7f77-409e-9642-200c7bcb90b9 tempest-VolumesSnapshotTestJSON-821295557 None] Flow 'volume_create_manager' (baf5145b-69ce-4f1b-8c13-b9c0076661a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:33:02 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-8f66c110-7f77-409e-9642-200c7bcb90b9 tempest-VolumesSnapshotTestJSON-821295557 None] Created volume successfully.
Apr 02 10:33:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ec7f05d4-957d-4b0b-965d-bcc4696ce181 tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:33:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ec7f05d4-957d-4b0b-965d-bcc4696ce181 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:33:03 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-ec7f05d4-957d-4b0b-965d-bcc4696ce181 tempest-VolumesSnapshotTestJSON-821295557 None] Creating offline snapshot 72da49cf-756f-4bbe-8720-4a6c35dac0ec of volume 9be83004-7563-4823-a6bd-bff887626070 {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:33:03 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2f7e9c-93a7-4bf9-ae4a-250a77730fc8]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:33:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ec7f05d4-957d-4b0b-965d-bcc4696ce181 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:03 devstack sudo[89145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070
Apr 02 10:33:03 devstack sudo[89145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:04 devstack sudo[89145]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ec7f05d4-957d-4b0b-965d-bcc4696ce181 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070" returned: 0 in 0.561s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ec7f05d4-957d-4b0b-965d-bcc4696ce181 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070.72da49cf-756f-4bbe-8720-4a6c35dac0ec 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:04 devstack sudo[89150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070.72da49cf-756f-4bbe-8720-4a6c35dac0ec 1G
Apr 02 10:33:04 devstack sudo[89150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:04 devstack sudo[89150]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ec7f05d4-957d-4b0b-965d-bcc4696ce181 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070.72da49cf-756f-4bbe-8720-4a6c35dac0ec 1G" returned: 0 in 0.561s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ec7f05d4-957d-4b0b-965d-bcc4696ce181 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9be83004-7563-4823-a6bd-bff887626070 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070.72da49cf-756f-4bbe-8720-4a6c35dac0ec {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:05 devstack sudo[89155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9be83004-7563-4823-a6bd-bff887626070 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070.72da49cf-756f-4bbe-8720-4a6c35dac0ec
Apr 02 10:33:05 devstack sudo[89155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:05 devstack sudo[89155]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ec7f05d4-957d-4b0b-965d-bcc4696ce181 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9be83004-7563-4823-a6bd-bff887626070 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070.72da49cf-756f-4bbe-8720-4a6c35dac0ec" returned: 0 in 0.561s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:05 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-ec7f05d4-957d-4b0b-965d-bcc4696ce181 tempest-VolumesSnapshotTestJSON-821295557 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070.72da49cf-756f-4bbe-8720-4a6c35dac0ec is being set with open permissions: ugo+rw
Apr 02 10:33:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ec7f05d4-957d-4b0b-965d-bcc4696ce181 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070.72da49cf-756f-4bbe-8720-4a6c35dac0ec {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:05 devstack sudo[89160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070.72da49cf-756f-4bbe-8720-4a6c35dac0ec
Apr 02 10:33:05 devstack sudo[89160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:05 devstack sudo[89160]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ec7f05d4-957d-4b0b-965d-bcc4696ce181 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070.72da49cf-756f-4bbe-8720-4a6c35dac0ec" returned: 0 in 0.450s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ec7f05d4-957d-4b0b-965d-bcc4696ce181 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:06 devstack sudo[89163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070.info
Apr 02 10:33:06 devstack sudo[89163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:06 devstack sudo[89163]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ec7f05d4-957d-4b0b-965d-bcc4696ce181 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070.info" returned: 0 in 0.514s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:06 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-ec7f05d4-957d-4b0b-965d-bcc4696ce181 tempest-VolumesSnapshotTestJSON-821295557 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070.info is being set with open permissions: ugo+rw
Apr 02 10:33:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ec7f05d4-957d-4b0b-965d-bcc4696ce181 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:06 devstack sudo[89166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070.info
Apr 02 10:33:06 devstack sudo[89166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:06 devstack sudo[89166]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ec7f05d4-957d-4b0b-965d-bcc4696ce181 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070.info" returned: 0 in 0.459s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ec7f05d4-957d-4b0b-965d-bcc4696ce181 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.176s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:33:07 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-ec7f05d4-957d-4b0b-965d-bcc4696ce181 tempest-VolumesSnapshotTestJSON-821295557 None] Create snapshot completed successfully
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f4f0ba67-a8e2-407b-9cf2-ea8cbbe9c927 tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "cinder-72da49cf-756f-4bbe-8720-4a6c35dac0ec-delete_snapshot" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f4f0ba67-a8e2-407b-9cf2-ea8cbbe9c927 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-72da49cf-756f-4bbe-8720-4a6c35dac0ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f4f0ba67-a8e2-407b-9cf2-ea8cbbe9c927 tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "cinder-quobyte-9be83004-7563-4823-a6bd-bff887626070" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f4f0ba67-a8e2-407b-9cf2-ea8cbbe9c927 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-quobyte-9be83004-7563-4823-a6bd-bff887626070" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f4f0ba67-a8e2-407b-9cf2-ea8cbbe9c927 tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "cinder-quobyte-72da49cf-756f-4bbe-8720-4a6c35dac0ec" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f4f0ba67-a8e2-407b-9cf2-ea8cbbe9c927 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-quobyte-72da49cf-756f-4bbe-8720-4a6c35dac0ec" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-f4f0ba67-a8e2-407b-9cf2-ea8cbbe9c927 tempest-VolumesSnapshotTestJSON-821295557 None] Deleting offline snapshot 72da49cf-756f-4bbe-8720-4a6c35dac0ec of volume 9be83004-7563-4823-a6bd-bff887626070 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-f4f0ba67-a8e2-407b-9cf2-ea8cbbe9c927 tempest-VolumesSnapshotTestJSON-821295557 None] snapshot_file for this snap is: volume-9be83004-7563-4823-a6bd-bff887626070.72da49cf-756f-4bbe-8720-4a6c35dac0ec {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d832656-77df-43ae-b556-7e5d3d90446c]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f4f0ba67-a8e2-407b-9cf2-ea8cbbe9c927 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070.72da49cf-756f-4bbe-8720-4a6c35dac0ec {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:08 devstack sudo[89169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070.72da49cf-756f-4bbe-8720-4a6c35dac0ec
Apr 02 10:33:08 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc44d135-84b9-4873-afca-50fee9d7d149 tempest-SnapshotDependencyTests-405094569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bc44d135-84b9-4873-afca-50fee9d7d149 tempest-SnapshotDependencyTests-405094569 None] Flow 'volume_create_manager' (57ebc3d3-bd18-4e1a-9c9f-2d9bb1193244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bc44d135-84b9-4873-afca-50fee9d7d149 tempest-SnapshotDependencyTests-405094569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36fc3e91-bae9-43e9-b41d-d4e93d65b054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bc44d135-84b9-4873-afca-50fee9d7d149 tempest-SnapshotDependencyTests-405094569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36fc3e91-bae9-43e9-b41d-d4e93d65b054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1964032864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a7b7b3-579a-4477-ab34-25374a6de83b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1125c78ef5fe4ff4b24415ec8ef6d883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:33:09Z,use_quota=True,user_id='09768d690e9c4b239ddbbab7e7c36b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bc44d135-84b9-4873-afca-50fee9d7d149 tempest-SnapshotDependencyTests-405094569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07103274-dc25-41c9-a4e6-28ba992567ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bc44d135-84b9-4873-afca-50fee9d7d149 tempest-SnapshotDependencyTests-405094569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07103274-dc25-41c9-a4e6-28ba992567ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bc44d135-84b9-4873-afca-50fee9d7d149 tempest-SnapshotDependencyTests-405094569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92c621eb-c806-4d97-8f61-abb2d9c45ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bc44d135-84b9-4873-afca-50fee9d7d149 tempest-SnapshotDependencyTests-405094569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92c621eb-c806-4d97-8f61-abb2d9c45ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6a7b7b3-579a-4477-ab34-25374a6de83b', 'volume_name': 'volume-a6a7b7b3-579a-4477-ab34-25374a6de83b', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bc44d135-84b9-4873-afca-50fee9d7d149 tempest-SnapshotDependencyTests-405094569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87c97788-f5be-46f0-be40-3f18ff88f6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bc44d135-84b9-4873-afca-50fee9d7d149 tempest-SnapshotDependencyTests-405094569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87c97788-f5be-46f0-be40-3f18ff88f6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bc44d135-84b9-4873-afca-50fee9d7d149 tempest-SnapshotDependencyTests-405094569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fed2d84-2c69-4d6c-82c8-ca00200a1326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:08 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-bc44d135-84b9-4873-afca-50fee9d7d149 tempest-SnapshotDependencyTests-405094569 None] Volume a6a7b7b3-579a-4477-ab34-25374a6de83b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6a7b7b3-579a-4477-ab34-25374a6de83b', 'volume_size': 1}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bc44d135-84b9-4873-afca-50fee9d7d149 tempest-SnapshotDependencyTests-405094569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bc44d135-84b9-4873-afca-50fee9d7d149 tempest-SnapshotDependencyTests-405094569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-bc44d135-84b9-4873-afca-50fee9d7d149 tempest-SnapshotDependencyTests-405094569 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1964032864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a7b7b3-579a-4477-ab34-25374a6de83b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1125c78ef5fe4ff4b24415ec8ef6d883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:33:09Z,use_quota=True,user_id='09768d690e9c4b239ddbbab7e7c36b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-bc44d135-84b9-4873-afca-50fee9d7d149 tempest-SnapshotDependencyTests-405094569 None] Creating volume a6a7b7b3-579a-4477-ab34-25374a6de83b {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bc44d135-84b9-4873-afca-50fee9d7d149 tempest-SnapshotDependencyTests-405094569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bc44d135-84b9-4873-afca-50fee9d7d149 tempest-SnapshotDependencyTests-405094569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-bc44d135-84b9-4873-afca-50fee9d7d149 tempest-SnapshotDependencyTests-405094569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-bc44d135-84b9-4873-afca-50fee9d7d149 tempest-SnapshotDependencyTests-405094569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bc44d135-84b9-4873-afca-50fee9d7d149 tempest-SnapshotDependencyTests-405094569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-bc44d135-84b9-4873-afca-50fee9d7d149 tempest-SnapshotDependencyTests-405094569 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:33:08 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-bc44d135-84b9-4873-afca-50fee9d7d149 tempest-SnapshotDependencyTests-405094569 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bc44d135-84b9-4873-afca-50fee9d7d149 tempest-SnapshotDependencyTests-405094569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG oslo_service.periodic_task [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:33:08 devstack sudo[89171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b 1073741824
Apr 02 10:33:08 devstack sudo[89171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:08 devstack sudo[89173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:33:08 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:08 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f4f0ba67-a8e2-407b-9cf2-ea8cbbe9c927 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070.72da49cf-756f-4bbe-8720-4a6c35dac0ec" returned: 0 in 0.588s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-f4f0ba67-a8e2-407b-9cf2-ea8cbbe9c927 tempest-VolumesSnapshotTestJSON-821295557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9be83004-7563-4823-a6bd-bff887626070(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0149312b-f230-4404-a47f-8bc218bd07f6]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:33:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f4f0ba67-a8e2-407b-9cf2-ea8cbbe9c927 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:09 devstack sudo[89178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070
Apr 02 10:33:09 devstack sudo[89178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:09 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.546s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:09 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:33:09 devstack sudo[89171]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bc44d135-84b9-4873-afca-50fee9d7d149 tempest-SnapshotDependencyTests-405094569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b 1073741824" returned: 0 in 0.628s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bc44d135-84b9-4873-afca-50fee9d7d149 tempest-SnapshotDependencyTests-405094569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:09 devstack sudo[89184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b
Apr 02 10:33:09 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:09 devstack sudo[89178]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f4f0ba67-a8e2-407b-9cf2-ea8cbbe9c927 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070" returned: 0 in 0.672s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f4f0ba67-a8e2-407b-9cf2-ea8cbbe9c927 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070.72da49cf-756f-4bbe-8720-4a6c35dac0ec {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:09 devstack sudo[89189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070.72da49cf-756f-4bbe-8720-4a6c35dac0ec
Apr 02 10:33:09 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:09 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-bc44d135-84b9-4873-afca-50fee9d7d149 tempest-SnapshotDependencyTests-405094569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b" returned: 0 in 0.484s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:09 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-bc44d135-84b9-4873-afca-50fee9d7d149 tempest-SnapshotDependencyTests-405094569 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:33:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-bc44d135-84b9-4873-afca-50fee9d7d149 tempest-SnapshotDependencyTests-405094569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:33:09 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bc44d135-84b9-4873-afca-50fee9d7d149 tempest-SnapshotDependencyTests-405094569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fed2d84-2c69-4d6c-82c8-ca00200a1326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6a7b7b3-579a-4477-ab34-25374a6de83b', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:09 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bc44d135-84b9-4873-afca-50fee9d7d149 tempest-SnapshotDependencyTests-405094569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6126e1a5-7c0c-4f24-9e0a-e983cff12ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:09 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-bc44d135-84b9-4873-afca-50fee9d7d149 tempest-SnapshotDependencyTests-405094569 None] Volume volume-a6a7b7b3-579a-4477-ab34-25374a6de83b (a6a7b7b3-579a-4477-ab34-25374a6de83b): created successfully
Apr 02 10:33:09 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bc44d135-84b9-4873-afca-50fee9d7d149 tempest-SnapshotDependencyTests-405094569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6126e1a5-7c0c-4f24-9e0a-e983cff12ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:09 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-bc44d135-84b9-4873-afca-50fee9d7d149 tempest-SnapshotDependencyTests-405094569 None] Flow 'volume_create_manager' (57ebc3d3-bd18-4e1a-9c9f-2d9bb1193244) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:33:09 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-bc44d135-84b9-4873-afca-50fee9d7d149 tempest-SnapshotDependencyTests-405094569 None] Created volume successfully.
Apr 02 10:33:10 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f4f0ba67-a8e2-407b-9cf2-ea8cbbe9c927 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070.72da49cf-756f-4bbe-8720-4a6c35dac0ec" returned: 0 in 0.531s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f4f0ba67-a8e2-407b-9cf2-ea8cbbe9c927 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070.72da49cf-756f-4bbe-8720-4a6c35dac0ec {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:10 devstack sudo[89195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070.72da49cf-756f-4bbe-8720-4a6c35dac0ec
Apr 02 10:33:10 devstack sudo[89195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:10 devstack sudo[89195]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f4f0ba67-a8e2-407b-9cf2-ea8cbbe9c927 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070.72da49cf-756f-4bbe-8720-4a6c35dac0ec" returned: 0 in 0.448s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:10 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f4f0ba67-a8e2-407b-9cf2-ea8cbbe9c927 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-quobyte-72da49cf-756f-4bbe-8720-4a6c35dac0ec" released by "_delete_snapshot" :: held 2.312s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:33:10 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f4f0ba67-a8e2-407b-9cf2-ea8cbbe9c927 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-quobyte-9be83004-7563-4823-a6bd-bff887626070" released by "delete_snapshot" :: held 2.326s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:33:10 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-f4f0ba67-a8e2-407b-9cf2-ea8cbbe9c927 tempest-VolumesSnapshotTestJSON-821295557 None] Created reservations ['ec897941-bf89-4073-b996-07d5a5a92171', 'c53a5d6b-f242-48b6-8607-12ceeada8915', 'c6db8afc-6e5e-4541-9dca-1be131358e77', '816d2d00-4622-46c0-8bc6-1599b018e54c'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:33:10 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-f4f0ba67-a8e2-407b-9cf2-ea8cbbe9c927 tempest-VolumesSnapshotTestJSON-821295557 None] Delete snapshot completed successfully.
Apr 02 10:33:10 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f4f0ba67-a8e2-407b-9cf2-ea8cbbe9c927 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-72da49cf-756f-4bbe-8720-4a6c35dac0ec-delete_snapshot" released by "delete_snapshot" :: held 2.491s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:33:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-4be530b3-adbb-477d-ac28-1565d241fa95 tempest-SnapshotDependencyTests-405094569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:33:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-4be530b3-adbb-477d-ac28-1565d241fa95 tempest-SnapshotDependencyTests-405094569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:33:10 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-4be530b3-adbb-477d-ac28-1565d241fa95 tempest-SnapshotDependencyTests-405094569 None] Creating offline snapshot 602862b5-d52f-43bb-bdbd-738da851466c of volume a6a7b7b3-579a-4477-ab34-25374a6de83b {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:33:10 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71ae464-a83e-43ad-85c6-b53b041f161c]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:33:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4be530b3-adbb-477d-ac28-1565d241fa95 tempest-SnapshotDependencyTests-405094569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:11 devstack sudo[89199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b
Apr 02 10:33:11 devstack sudo[89199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:11 devstack sudo[89199]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4be530b3-adbb-477d-ac28-1565d241fa95 tempest-SnapshotDependencyTests-405094569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b" returned: 0 in 0.521s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4be530b3-adbb-477d-ac28-1565d241fa95 tempest-SnapshotDependencyTests-405094569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b.602862b5-d52f-43bb-bdbd-738da851466c 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:11 devstack sudo[89204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b.602862b5-d52f-43bb-bdbd-738da851466c 1G
Apr 02 10:33:11 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:11 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a6b2ad0-0d83-43b3-805d-b6769c5c8baf tempest-VolumesSnapshotTestJSON-821295557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:33:11 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-1a6b2ad0-0d83-43b3-805d-b6769c5c8baf tempest-VolumesSnapshotTestJSON-821295557 None] Flow 'volume_create_manager' (453917cc-e62e-4d02-88f4-80a5fa3e4996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:33:11 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-1a6b2ad0-0d83-43b3-805d-b6769c5c8baf tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac903daf-a886-462b-aaf1-3ab14c2c5ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:11 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-1a6b2ad0-0d83-43b3-805d-b6769c5c8baf tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac903daf-a886-462b-aaf1-3ab14c2c5ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:33:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-903144200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d349cd-472a-4fc5-9a9b-f1de43f921a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8924dff136241a2836da95789bd4859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:33:12Z,use_quota=True,user_id='9af7926171e44d8788c8a5dfb8ac1f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:11 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-1a6b2ad0-0d83-43b3-805d-b6769c5c8baf tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d826fd6-a602-4e83-9c1c-36d87b9c367b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:11 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-1a6b2ad0-0d83-43b3-805d-b6769c5c8baf tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d826fd6-a602-4e83-9c1c-36d87b9c367b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:11 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-1a6b2ad0-0d83-43b3-805d-b6769c5c8baf tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf6ec9d-ad46-4d5d-99ef-c6176c5499cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:11 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-1a6b2ad0-0d83-43b3-805d-b6769c5c8baf tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf6ec9d-ad46-4d5d-99ef-c6176c5499cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44d349cd-472a-4fc5-9a9b-f1de43f921a6', 'volume_name': 'volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:11 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-1a6b2ad0-0d83-43b3-805d-b6769c5c8baf tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55ef832f-90fc-4762-a167-92ae76568ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:11 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-1a6b2ad0-0d83-43b3-805d-b6769c5c8baf tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55ef832f-90fc-4762-a167-92ae76568ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:11 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-1a6b2ad0-0d83-43b3-805d-b6769c5c8baf tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33aa103-2651-44e5-983d-71ffc67d1ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:11 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-1a6b2ad0-0d83-43b3-805d-b6769c5c8baf tempest-VolumesSnapshotTestJSON-821295557 None] Volume 44d349cd-472a-4fc5-9a9b-f1de43f921a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6', 'volume_size': 1}
Apr 02 10:33:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-1a6b2ad0-0d83-43b3-805d-b6769c5c8baf tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:33:12 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4be530b3-adbb-477d-ac28-1565d241fa95 tempest-SnapshotDependencyTests-405094569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b.602862b5-d52f-43bb-bdbd-738da851466c 1G" returned: 0 in 0.502s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4be530b3-adbb-477d-ac28-1565d241fa95 tempest-SnapshotDependencyTests-405094569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6a7b7b3-579a-4477-ab34-25374a6de83b -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b.602862b5-d52f-43bb-bdbd-738da851466c {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:12 devstack sudo[89209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6a7b7b3-579a-4477-ab34-25374a6de83b -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b.602862b5-d52f-43bb-bdbd-738da851466c
Apr 02 10:33:12 devstack sudo[89209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:12 devstack sudo[89209]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4be530b3-adbb-477d-ac28-1565d241fa95 tempest-SnapshotDependencyTests-405094569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6a7b7b3-579a-4477-ab34-25374a6de83b -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b.602862b5-d52f-43bb-bdbd-738da851466c" returned: 0 in 0.486s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:12 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-4be530b3-adbb-477d-ac28-1565d241fa95 tempest-SnapshotDependencyTests-405094569 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b.602862b5-d52f-43bb-bdbd-738da851466c is being set with open permissions: ugo+rw
Apr 02 10:33:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4be530b3-adbb-477d-ac28-1565d241fa95 tempest-SnapshotDependencyTests-405094569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b.602862b5-d52f-43bb-bdbd-738da851466c {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:12 devstack sudo[89214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b.602862b5-d52f-43bb-bdbd-738da851466c
Apr 02 10:33:12 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:12 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4be530b3-adbb-477d-ac28-1565d241fa95 tempest-SnapshotDependencyTests-405094569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b.602862b5-d52f-43bb-bdbd-738da851466c" returned: 0 in 0.443s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4be530b3-adbb-477d-ac28-1565d241fa95 tempest-SnapshotDependencyTests-405094569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:12 devstack sudo[89217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b.info
Apr 02 10:33:12 devstack sudo[89217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:13 devstack sudo[89217]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4be530b3-adbb-477d-ac28-1565d241fa95 tempest-SnapshotDependencyTests-405094569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b.info" returned: 0 in 0.400s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:13 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-4be530b3-adbb-477d-ac28-1565d241fa95 tempest-SnapshotDependencyTests-405094569 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b.info is being set with open permissions: ugo+rw
Apr 02 10:33:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4be530b3-adbb-477d-ac28-1565d241fa95 tempest-SnapshotDependencyTests-405094569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:13 devstack sudo[89220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b.info
Apr 02 10:33:13 devstack sudo[89220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:13 devstack sudo[89220]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-4be530b3-adbb-477d-ac28-1565d241fa95 tempest-SnapshotDependencyTests-405094569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b.info" returned: 0 in 0.395s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-4be530b3-adbb-477d-ac28-1565d241fa95 tempest-SnapshotDependencyTests-405094569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.829s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:33:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-1a6b2ad0-0d83-43b3-805d-b6769c5c8baf tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.918s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:33:13 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-1a6b2ad0-0d83-43b3-805d-b6769c5c8baf tempest-VolumesSnapshotTestJSON-821295557 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:33:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-903144200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d349cd-472a-4fc5-9a9b-f1de43f921a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8924dff136241a2836da95789bd4859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:33:12Z,use_quota=True,user_id='9af7926171e44d8788c8a5dfb8ac1f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:33:13 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-1a6b2ad0-0d83-43b3-805d-b6769c5c8baf tempest-VolumesSnapshotTestJSON-821295557 None] Creating volume 44d349cd-472a-4fc5-9a9b-f1de43f921a6 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:33:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-1a6b2ad0-0d83-43b3-805d-b6769c5c8baf tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:33:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-1a6b2ad0-0d83-43b3-805d-b6769c5c8baf tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:33:13 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-1a6b2ad0-0d83-43b3-805d-b6769c5c8baf tempest-VolumesSnapshotTestJSON-821295557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:33:13 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-1a6b2ad0-0d83-43b3-805d-b6769c5c8baf tempest-VolumesSnapshotTestJSON-821295557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:33:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-1a6b2ad0-0d83-43b3-805d-b6769c5c8baf tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:33:13 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-1a6b2ad0-0d83-43b3-805d-b6769c5c8baf tempest-VolumesSnapshotTestJSON-821295557 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:33:13 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-1a6b2ad0-0d83-43b3-805d-b6769c5c8baf tempest-VolumesSnapshotTestJSON-821295557 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:33:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1a6b2ad0-0d83-43b3-805d-b6769c5c8baf tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:13 devstack sudo[89223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6 1073741824
Apr 02 10:33:13 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:13 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-4be530b3-adbb-477d-ac28-1565d241fa95 tempest-SnapshotDependencyTests-405094569 None] Create snapshot completed successfully
Apr 02 10:33:14 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1a6b2ad0-0d83-43b3-805d-b6769c5c8baf tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6 1073741824" returned: 0 in 0.528s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1a6b2ad0-0d83-43b3-805d-b6769c5c8baf tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:14 devstack sudo[89228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6
Apr 02 10:33:14 devstack sudo[89228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Flow 'volume_create_manager' (fd21d38f-a048-4d2e-abc4-01b69c44bbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (510c0bbc-ee3b-432f-91c8-bcefc6dbe672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (510c0bbc-ee3b-432f-91c8-bcefc6dbe672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21563b07-9fd8-4732-af8c-d6f9362c498f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1125c78ef5fe4ff4b24415ec8ef6d883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=602862b5-d52f-43bb-bdbd-738da851466c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:33:14Z,use_quota=True,user_id='09768d690e9c4b239ddbbab7e7c36b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94a2503c-5d62-40aa-80e6-8e38455c3677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94a2503c-5d62-40aa-80e6-8e38455c3677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2489c74e-224d-4563-b1a9-b2ed28ffc7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2489c74e-224d-4563-b1a9-b2ed28ffc7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '21563b07-9fd8-4732-af8c-d6f9362c498f', 'volume_name': 'volume-21563b07-9fd8-4732-af8c-d6f9362c498f', 'volume_size': 1, 'snapshot_id': '602862b5-d52f-43bb-bdbd-738da851466c'}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd5c857-c3f6-44fe-9303-fdc0dabd62a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd5c857-c3f6-44fe-9303-fdc0dabd62a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c37f5d45-9395-45b2-a5ca-c4115921bc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:14 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Volume 21563b07-9fd8-4732-af8c-d6f9362c498f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-21563b07-9fd8-4732-af8c-d6f9362c498f', 'volume_size': 1, 'snapshot_id': '602862b5-d52f-43bb-bdbd-738da851466c'}
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:33:14 devstack sudo[89228]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1a6b2ad0-0d83-43b3-805d-b6769c5c8baf tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6" returned: 0 in 0.447s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-1a6b2ad0-0d83-43b3-805d-b6769c5c8baf tempest-VolumesSnapshotTestJSON-821295557 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-1a6b2ad0-0d83-43b3-805d-b6769c5c8baf tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.286s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Acquiring lock "cinder-quobyte-602862b5-d52f-43bb-bdbd-738da851466c-21563b07-9fd8-4732-af8c-d6f9362c498f" by "_create_volume_from_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-1a6b2ad0-0d83-43b3-805d-b6769c5c8baf tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33aa103-2651-44e5-983d-71ffc67d1ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-1a6b2ad0-0d83-43b3-805d-b6769c5c8baf tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68baec6a-ccb5-4db2-9640-988ea597e3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:14 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-1a6b2ad0-0d83-43b3-805d-b6769c5c8baf tempest-VolumesSnapshotTestJSON-821295557 None] Volume volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6 (44d349cd-472a-4fc5-9a9b-f1de43f921a6): created successfully
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-1a6b2ad0-0d83-43b3-805d-b6769c5c8baf tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68baec6a-ccb5-4db2-9640-988ea597e3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-1a6b2ad0-0d83-43b3-805d-b6769c5c8baf tempest-VolumesSnapshotTestJSON-821295557 None] Flow 'volume_create_manager' (453917cc-e62e-4d02-88f4-80a5fa3e4996) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Lock "cinder-quobyte-602862b5-d52f-43bb-bdbd-738da851466c-21563b07-9fd8-4732-af8c-d6f9362c498f" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Creating volume 21563b07-9fd8-4732-af8c-d6f9362c498f from snapshot 602862b5-d52f-43bb-bdbd-738da851466c {{(pid=82102) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Acquiring lock "cinder-quobyte-21563b07-9fd8-4732-af8c-d6f9362c498f" by "_copy_volume_from_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:33:14 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-1a6b2ad0-0d83-43b3-805d-b6769c5c8baf tempest-VolumesSnapshotTestJSON-821295557 None] Created volume successfully.
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Lock "cinder-quobyte-21563b07-9fd8-4732-af8c-d6f9362c498f" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] snapshot: 602862b5-d52f-43bb-bdbd-738da851466c, volume: 21563b07-9fd8-4732-af8c-d6f9362c498f,  {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fae7bf2-3a11-4086-a335-d3ca3f4da390]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:33:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b.602862b5-d52f-43bb-bdbd-738da851466c {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:14 devstack sudo[89232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b.602862b5-d52f-43bb-bdbd-738da851466c
Apr 02 10:33:14 devstack sudo[89232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e307eabf-5e5f-4749-bf48-80c8bf8c4a74 tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:33:15 devstack sudo[89232]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b.602862b5-d52f-43bb-bdbd-738da851466c" returned: 0 in 0.497s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6a7b7b3-579a-4477-ab34-25374a6de83b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:33:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 02 10:33:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Creating direct copy from snapshot {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 02 10:33:15 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31ce8ef-cce5-4597-8422-7c43adec6f6a]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:33:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:15 devstack sudo[89237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b
Apr 02 10:33:15 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:15 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b" returned: 0 in 0.540s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:15 devstack cinder-volume[82102]: DEBUG cinder.utils [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Path /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-21563b07-9fd8-4732-af8c-d6f9362c498f not found in is_blk_device check {{(pid=82102) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 02 10:33:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-21563b07-9fd8-4732-af8c-d6f9362c498f {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:15 devstack sudo[89242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-21563b07-9fd8-4732-af8c-d6f9362c498f
Apr 02 10:33:15 devstack sudo[89242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:17 devstack sudo[89242]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-21563b07-9fd8-4732-af8c-d6f9362c498f" returned: 0 in 1.962s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:17 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db751c6-44cc-43f9-a630-748427e46cc0]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:33:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:17 devstack sudo[89254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b
Apr 02 10:33:17 devstack sudo[89254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:18 devstack sudo[89254]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b" returned: 0 in 0.545s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:18 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Image conversion details: src /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b, size 1024.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-21563b07-9fd8-4732-af8c-d6f9362c498f {{(pid=82102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 02 10:33:18 devstack cinder-volume[82102]: INFO cinder.image.image_utils [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Converted 1024.00 MB image at 521.53 MB/s
Apr 02 10:33:18 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-21563b07-9fd8-4732-af8c-d6f9362c498f is being set with open permissions: ugo+rw
Apr 02 10:33:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-21563b07-9fd8-4732-af8c-d6f9362c498f {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:18 devstack sudo[89259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-21563b07-9fd8-4732-af8c-d6f9362c498f
Apr 02 10:33:18 devstack sudo[89259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:18 devstack sudo[89259]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-21563b07-9fd8-4732-af8c-d6f9362c498f" returned: 0 in 0.378s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:18 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Lock "cinder-quobyte-21563b07-9fd8-4732-af8c-d6f9362c498f" released by "_copy_volume_from_snapshot" :: held 3.984s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:33:18 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Lock "cinder-quobyte-602862b5-d52f-43bb-bdbd-738da851466c-21563b07-9fd8-4732-af8c-d6f9362c498f" released by "_create_volume_from_snapshot" :: held 4.006s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:33:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.043s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:33:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e307eabf-5e5f-4749-bf48-80c8bf8c4a74 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.761s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:33:18 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-e307eabf-5e5f-4749-bf48-80c8bf8c4a74 tempest-VolumesSnapshotTestJSON-821295557 None] Creating offline snapshot e13a4f71-d447-4af7-b73a-bc2144062689 of volume 44d349cd-472a-4fc5-9a9b-f1de43f921a6 {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:33:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c37f5d45-9395-45b2-a5ca-c4115921bc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21563b07-9fd8-4732-af8c-d6f9362c498f', 'volume_size': 1, 'snapshot_id': '602862b5-d52f-43bb-bdbd-738da851466c'}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b755d1b-028e-42ec-bdeb-8ef53fbc1d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:18 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3455f0b-c2eb-4088-93dc-753d3800e63f]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:33:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e307eabf-5e5f-4749-bf48-80c8bf8c4a74 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:18 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Volume volume-21563b07-9fd8-4732-af8c-d6f9362c498f (21563b07-9fd8-4732-af8c-d6f9362c498f): created successfully
Apr 02 10:33:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b755d1b-028e-42ec-bdeb-8ef53fbc1d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:18 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Flow 'volume_create_manager' (fd21d38f-a048-4d2e-abc4-01b69c44bbae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:33:18 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-3c9727d0-e9d4-426d-ab9b-d0cda4d9cb37 tempest-SnapshotDependencyTests-405094569 None] Created volume successfully.
Apr 02 10:33:18 devstack sudo[89262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6
Apr 02 10:33:18 devstack sudo[89262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:19 devstack sudo[89262]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e307eabf-5e5f-4749-bf48-80c8bf8c4a74 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6" returned: 0 in 0.470s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e307eabf-5e5f-4749-bf48-80c8bf8c4a74 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6.e13a4f71-d447-4af7-b73a-bc2144062689 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:19 devstack sudo[89267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6.e13a4f71-d447-4af7-b73a-bc2144062689 1G
Apr 02 10:33:19 devstack sudo[89267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:19 devstack sudo[89267]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e307eabf-5e5f-4749-bf48-80c8bf8c4a74 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6.e13a4f71-d447-4af7-b73a-bc2144062689 1G" returned: 0 in 0.457s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e307eabf-5e5f-4749-bf48-80c8bf8c4a74 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6.e13a4f71-d447-4af7-b73a-bc2144062689 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:19 devstack sudo[89272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6.e13a4f71-d447-4af7-b73a-bc2144062689
Apr 02 10:33:19 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:19 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3838804a-c355-499f-9275-8ea142ed2d0e tempest-SnapshotDependencyTests-405094569 None] Acquiring lock "cinder-602862b5-d52f-43bb-bdbd-738da851466c-delete_snapshot" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:33:19 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3838804a-c355-499f-9275-8ea142ed2d0e tempest-SnapshotDependencyTests-405094569 None] Lock "cinder-602862b5-d52f-43bb-bdbd-738da851466c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:33:19 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3838804a-c355-499f-9275-8ea142ed2d0e tempest-SnapshotDependencyTests-405094569 None] Acquiring lock "cinder-quobyte-a6a7b7b3-579a-4477-ab34-25374a6de83b" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:33:19 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3838804a-c355-499f-9275-8ea142ed2d0e tempest-SnapshotDependencyTests-405094569 None] Lock "cinder-quobyte-a6a7b7b3-579a-4477-ab34-25374a6de83b" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:33:19 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3838804a-c355-499f-9275-8ea142ed2d0e tempest-SnapshotDependencyTests-405094569 None] Acquiring lock "cinder-quobyte-602862b5-d52f-43bb-bdbd-738da851466c" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:33:19 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3838804a-c355-499f-9275-8ea142ed2d0e tempest-SnapshotDependencyTests-405094569 None] Lock "cinder-quobyte-602862b5-d52f-43bb-bdbd-738da851466c" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:33:19 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-3838804a-c355-499f-9275-8ea142ed2d0e tempest-SnapshotDependencyTests-405094569 None] Deleting offline snapshot 602862b5-d52f-43bb-bdbd-738da851466c of volume a6a7b7b3-579a-4477-ab34-25374a6de83b {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:33:19 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-3838804a-c355-499f-9275-8ea142ed2d0e tempest-SnapshotDependencyTests-405094569 None] snapshot_file for this snap is: volume-a6a7b7b3-579a-4477-ab34-25374a6de83b.602862b5-d52f-43bb-bdbd-738da851466c {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:33:19 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[be74e6f2-09bd-492e-9eb3-2187529a2b71]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:33:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3838804a-c355-499f-9275-8ea142ed2d0e tempest-SnapshotDependencyTests-405094569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b.602862b5-d52f-43bb-bdbd-738da851466c {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:20 devstack sudo[89274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b.602862b5-d52f-43bb-bdbd-738da851466c
Apr 02 10:33:20 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:20 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e307eabf-5e5f-4749-bf48-80c8bf8c4a74 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6.e13a4f71-d447-4af7-b73a-bc2144062689" returned: 0 in 0.456s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:20 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-e307eabf-5e5f-4749-bf48-80c8bf8c4a74 tempest-VolumesSnapshotTestJSON-821295557 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6.e13a4f71-d447-4af7-b73a-bc2144062689 is being set with open permissions: ugo+rw
Apr 02 10:33:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e307eabf-5e5f-4749-bf48-80c8bf8c4a74 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6.e13a4f71-d447-4af7-b73a-bc2144062689 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:20 devstack sudo[89279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6.e13a4f71-d447-4af7-b73a-bc2144062689
Apr 02 10:33:20 devstack sudo[89279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:20 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3838804a-c355-499f-9275-8ea142ed2d0e tempest-SnapshotDependencyTests-405094569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b.602862b5-d52f-43bb-bdbd-738da851466c" returned: 0 in 0.487s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:20 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-3838804a-c355-499f-9275-8ea142ed2d0e tempest-SnapshotDependencyTests-405094569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6a7b7b3-579a-4477-ab34-25374a6de83b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:33:20 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc4f539-139d-40f6-83ed-2b3802ced8fc]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:33:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3838804a-c355-499f-9275-8ea142ed2d0e tempest-SnapshotDependencyTests-405094569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:20 devstack sudo[89284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b
Apr 02 10:33:20 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:20 devstack sudo[89279]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e307eabf-5e5f-4749-bf48-80c8bf8c4a74 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6.e13a4f71-d447-4af7-b73a-bc2144062689" returned: 0 in 0.444s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e307eabf-5e5f-4749-bf48-80c8bf8c4a74 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:20 devstack sudo[89287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6.info
Apr 02 10:33:20 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:20 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3838804a-c355-499f-9275-8ea142ed2d0e tempest-SnapshotDependencyTests-405094569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b" returned: 0 in 0.486s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3838804a-c355-499f-9275-8ea142ed2d0e tempest-SnapshotDependencyTests-405094569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b.602862b5-d52f-43bb-bdbd-738da851466c {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:20 devstack sudo[89293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b.602862b5-d52f-43bb-bdbd-738da851466c
Apr 02 10:33:21 devstack sudo[89293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:21 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e307eabf-5e5f-4749-bf48-80c8bf8c4a74 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6.info" returned: 0 in 0.408s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:21 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-e307eabf-5e5f-4749-bf48-80c8bf8c4a74 tempest-VolumesSnapshotTestJSON-821295557 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6.info is being set with open permissions: ugo+rw
Apr 02 10:33:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e307eabf-5e5f-4749-bf48-80c8bf8c4a74 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:21 devstack sudo[89296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6.info
Apr 02 10:33:21 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:21 devstack sudo[89293]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3838804a-c355-499f-9275-8ea142ed2d0e tempest-SnapshotDependencyTests-405094569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b.602862b5-d52f-43bb-bdbd-738da851466c" returned: 0 in 0.440s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3838804a-c355-499f-9275-8ea142ed2d0e tempest-SnapshotDependencyTests-405094569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b.602862b5-d52f-43bb-bdbd-738da851466c {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:21 devstack sudo[89301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b.602862b5-d52f-43bb-bdbd-738da851466c
Apr 02 10:33:21 devstack sudo[89301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:21 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e307eabf-5e5f-4749-bf48-80c8bf8c4a74 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6.info" returned: 0 in 0.418s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e307eabf-5e5f-4749-bf48-80c8bf8c4a74 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.719s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:33:21 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-e307eabf-5e5f-4749-bf48-80c8bf8c4a74 tempest-VolumesSnapshotTestJSON-821295557 None] Create snapshot completed successfully
Apr 02 10:33:21 devstack sudo[89301]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3838804a-c355-499f-9275-8ea142ed2d0e tempest-SnapshotDependencyTests-405094569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b.602862b5-d52f-43bb-bdbd-738da851466c" returned: 0 in 0.403s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:21 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3838804a-c355-499f-9275-8ea142ed2d0e tempest-SnapshotDependencyTests-405094569 None] Lock "cinder-quobyte-602862b5-d52f-43bb-bdbd-738da851466c" released by "_delete_snapshot" :: held 1.867s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:33:21 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3838804a-c355-499f-9275-8ea142ed2d0e tempest-SnapshotDependencyTests-405094569 None] Lock "cinder-quobyte-a6a7b7b3-579a-4477-ab34-25374a6de83b" released by "delete_snapshot" :: held 1.883s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:33:21 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-3838804a-c355-499f-9275-8ea142ed2d0e tempest-SnapshotDependencyTests-405094569 None] Created reservations ['07eb073b-bb30-4138-9723-b99ee0a39a27', '1064f9de-14dc-4b83-994e-f892bae28ca8', 'a8982ded-ae5d-4703-a31a-59e4b87c34e4', 'ef163a41-44ff-408b-9e7e-82f81c8f2b00'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:33:21 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-3838804a-c355-499f-9275-8ea142ed2d0e tempest-SnapshotDependencyTests-405094569 None] Delete snapshot completed successfully.
Apr 02 10:33:21 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3838804a-c355-499f-9275-8ea142ed2d0e tempest-SnapshotDependencyTests-405094569 None] Lock "cinder-602862b5-d52f-43bb-bdbd-738da851466c-delete_snapshot" released by "delete_snapshot" :: held 1.971s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-6992366e-bd59-43bf-a616-8e7da7ebcc63 tempest-SnapshotDependencyTests-405094569 None] Acquiring lock "cinder-a6a7b7b3-579a-4477-ab34-25374a6de83b-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-6992366e-bd59-43bf-a616-8e7da7ebcc63 tempest-SnapshotDependencyTests-405094569 None] Lock "cinder-a6a7b7b3-579a-4477-ab34-25374a6de83b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-6992366e-bd59-43bf-a616-8e7da7ebcc63 tempest-SnapshotDependencyTests-405094569 None] Acquiring lock "cinder-quobyte-a6a7b7b3-579a-4477-ab34-25374a6de83b" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-6992366e-bd59-43bf-a616-8e7da7ebcc63 tempest-SnapshotDependencyTests-405094569 None] Lock "cinder-quobyte-a6a7b7b3-579a-4477-ab34-25374a6de83b" acquired by "delete_volume" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b6c244-edd7-4cc6-9041-15b9380fe8b5]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6992366e-bd59-43bf-a616-8e7da7ebcc63 tempest-SnapshotDependencyTests-405094569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:22 devstack sudo[89305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b
Apr 02 10:33:22 devstack sudo[89305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Flow 'volume_create_manager' (ad2e258c-600b-4ea2-9b88-7b72ec573497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:33:22 devstack sudo[89305]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161b6ae0-6256-4fd4-9b7c-db281609dfc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6992366e-bd59-43bf-a616-8e7da7ebcc63 tempest-SnapshotDependencyTests-405094569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b" returned: 0 in 0.549s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6992366e-bd59-43bf-a616-8e7da7ebcc63 tempest-SnapshotDependencyTests-405094569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:22 devstack sudo[89310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b
Apr 02 10:33:22 devstack sudo[89310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161b6ae0-6256-4fd4-9b7c-db281609dfc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1635042121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8924dff136241a2836da95789bd4859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:33:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=e13a4f71-d447-4af7-b73a-bc2144062689,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:33:23Z,use_quota=True,user_id='9af7926171e44d8788c8a5dfb8ac1f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d838f010-6e1b-400d-b4b7-4683e91aced0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d838f010-6e1b-400d-b4b7-4683e91aced0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ef9d18-82c6-48ae-bd66-d3df62445b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ef9d18-82c6-48ae-bd66-d3df62445b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86', 'volume_name': 'volume-b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86', 'volume_size': 2, 'snapshot_id': 'e13a4f71-d447-4af7-b73a-bc2144062689'}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2bf7361-e9b8-4fab-bc76-1b5907a63e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2bf7361-e9b8-4fab-bc76-1b5907a63e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1040d18e-a542-4afa-bea0-fb7734a87c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:22 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Volume b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86', 'volume_size': 2, 'snapshot_id': 'e13a4f71-d447-4af7-b73a-bc2144062689'}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "cinder-quobyte-e13a4f71-d447-4af7-b73a-bc2144062689-b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86" by "_create_volume_from_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-quobyte-e13a4f71-d447-4af7-b73a-bc2144062689-b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Creating volume b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86 from snapshot e13a4f71-d447-4af7-b73a-bc2144062689 {{(pid=82102) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "cinder-quobyte-b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86" by "_copy_volume_from_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-quobyte-b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] snapshot: e13a4f71-d447-4af7-b73a-bc2144062689, volume: b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86,  {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4f3a0f-4f1f-4823-9635-c226b4e8d95e]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:33:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6.e13a4f71-d447-4af7-b73a-bc2144062689 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:22 devstack sudo[89312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6.e13a4f71-d447-4af7-b73a-bc2144062689
Apr 02 10:33:22 devstack sudo[89312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:23 devstack sudo[89310]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6992366e-bd59-43bf-a616-8e7da7ebcc63 tempest-SnapshotDependencyTests-405094569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a6a7b7b3-579a-4477-ab34-25374a6de83b" returned: 0 in 0.424s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:23 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-6992366e-bd59-43bf-a616-8e7da7ebcc63 tempest-SnapshotDependencyTests-405094569 None] Lock "cinder-quobyte-a6a7b7b3-579a-4477-ab34-25374a6de83b" released by "delete_volume" :: held 1.003s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:33:23 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-6992366e-bd59-43bf-a616-8e7da7ebcc63 tempest-SnapshotDependencyTests-405094569 None] Created reservations ['60929a90-fcb2-4cdf-b742-db9117553c03', 'd7bef387-8a8a-4f4b-afbb-c2ca5b7b59f3', 'f6faebd1-0b4b-4bd1-9511-ae72af920839', 'acdd1f5d-de4f-4ed4-ae9f-5a42bc44d3bd'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:33:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-6992366e-bd59-43bf-a616-8e7da7ebcc63 tempest-SnapshotDependencyTests-405094569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:33:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-6992366e-bd59-43bf-a616-8e7da7ebcc63 tempest-SnapshotDependencyTests-405094569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:33:23 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-6992366e-bd59-43bf-a616-8e7da7ebcc63 tempest-SnapshotDependencyTests-405094569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:33:23 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-6992366e-bd59-43bf-a616-8e7da7ebcc63 tempest-SnapshotDependencyTests-405094569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:33:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-6992366e-bd59-43bf-a616-8e7da7ebcc63 tempest-SnapshotDependencyTests-405094569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:33:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6992366e-bd59-43bf-a616-8e7da7ebcc63 tempest-SnapshotDependencyTests-405094569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:23 devstack sudo[89319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:33:23 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:23 devstack sudo[89312]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6.e13a4f71-d447-4af7-b73a-bc2144062689" returned: 0 in 0.514s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:23 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:33:23 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6 {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 02 10:33:23 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Creating direct copy from snapshot {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 02 10:33:23 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c2bece-9c45-45a7-a7c9-6283110edd29]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:33:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:23 devstack sudo[89321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6
Apr 02 10:33:23 devstack sudo[89321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:23 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-6992366e-bd59-43bf-a616-8e7da7ebcc63 tempest-SnapshotDependencyTests-405094569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.401s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:23 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-6992366e-bd59-43bf-a616-8e7da7ebcc63 tempest-SnapshotDependencyTests-405094569 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:33:23 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-6992366e-bd59-43bf-a616-8e7da7ebcc63 tempest-SnapshotDependencyTests-405094569 None] Deleted volume successfully.
Apr 02 10:33:23 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-6992366e-bd59-43bf-a616-8e7da7ebcc63 tempest-SnapshotDependencyTests-405094569 None] Lock "cinder-a6a7b7b3-579a-4477-ab34-25374a6de83b-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:33:23 devstack sudo[89321]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6" returned: 0 in 0.500s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:23 devstack cinder-volume[82102]: DEBUG cinder.utils [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Path /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86 not found in is_blk_device check {{(pid=82102) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 02 10:33:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:23 devstack sudo[89327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86
Apr 02 10:33:23 devstack sudo[89327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:24 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-e8ff5d48-1eee-46f2-b827-38e9b4d0289e tempest-SnapshotDependencyTests-405094569 None] Acquiring lock "cinder-21563b07-9fd8-4732-af8c-d6f9362c498f-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:33:24 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-e8ff5d48-1eee-46f2-b827-38e9b4d0289e tempest-SnapshotDependencyTests-405094569 None] Lock "cinder-21563b07-9fd8-4732-af8c-d6f9362c498f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:33:24 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-e8ff5d48-1eee-46f2-b827-38e9b4d0289e tempest-SnapshotDependencyTests-405094569 None] Acquiring lock "cinder-quobyte-21563b07-9fd8-4732-af8c-d6f9362c498f" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:33:24 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-e8ff5d48-1eee-46f2-b827-38e9b4d0289e tempest-SnapshotDependencyTests-405094569 None] Lock "cinder-quobyte-21563b07-9fd8-4732-af8c-d6f9362c498f" acquired by "delete_volume" :: waited 0.024s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:33:24 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfd94aa-0d5e-4331-a119-a833679ebf4a]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:33:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e8ff5d48-1eee-46f2-b827-38e9b4d0289e tempest-SnapshotDependencyTests-405094569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-21563b07-9fd8-4732-af8c-d6f9362c498f {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:24 devstack sudo[89339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-21563b07-9fd8-4732-af8c-d6f9362c498f
Apr 02 10:33:24 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:25 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e8ff5d48-1eee-46f2-b827-38e9b4d0289e tempest-SnapshotDependencyTests-405094569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-21563b07-9fd8-4732-af8c-d6f9362c498f" returned: 0 in 1.409s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e8ff5d48-1eee-46f2-b827-38e9b4d0289e tempest-SnapshotDependencyTests-405094569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-21563b07-9fd8-4732-af8c-d6f9362c498f {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:25 devstack sudo[89327]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86" returned: 0 in 2.064s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:25 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2097849f-48e5-41fe-81d2-0213a8a6566b]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:33:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:25 devstack sudo[89344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-21563b07-9fd8-4732-af8c-d6f9362c498f
Apr 02 10:33:25 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:25 devstack sudo[89346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6
Apr 02 10:33:25 devstack sudo[89346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:26 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e8ff5d48-1eee-46f2-b827-38e9b4d0289e tempest-SnapshotDependencyTests-405094569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-21563b07-9fd8-4732-af8c-d6f9362c498f" returned: 0 in 0.416s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:26 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-e8ff5d48-1eee-46f2-b827-38e9b4d0289e tempest-SnapshotDependencyTests-405094569 None] Lock "cinder-quobyte-21563b07-9fd8-4732-af8c-d6f9362c498f" released by "delete_volume" :: held 1.864s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:33:26 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-e8ff5d48-1eee-46f2-b827-38e9b4d0289e tempest-SnapshotDependencyTests-405094569 None] Created reservations ['119b62f6-e3c2-4533-b2ec-90724a8717ab', 'ec3c426f-0096-44c1-9369-86d2199838a3', '83203947-84e6-4b20-aaf2-a2c4926e7fca', '60e4f623-f319-48a4-954e-361fdf05d229'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:33:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e8ff5d48-1eee-46f2-b827-38e9b4d0289e tempest-SnapshotDependencyTests-405094569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:33:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e8ff5d48-1eee-46f2-b827-38e9b4d0289e tempest-SnapshotDependencyTests-405094569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:33:26 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e8ff5d48-1eee-46f2-b827-38e9b4d0289e tempest-SnapshotDependencyTests-405094569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:33:26 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e8ff5d48-1eee-46f2-b827-38e9b4d0289e tempest-SnapshotDependencyTests-405094569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:33:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e8ff5d48-1eee-46f2-b827-38e9b4d0289e tempest-SnapshotDependencyTests-405094569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:33:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e8ff5d48-1eee-46f2-b827-38e9b4d0289e tempest-SnapshotDependencyTests-405094569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:26 devstack sudo[89351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:33:26 devstack sudo[89351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:26 devstack sudo[89346]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6" returned: 0 in 0.630s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:26 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Image conversion details: src /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6, size 1024.00 MB, duration 2.07 sec, destination /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86 {{(pid=82102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 02 10:33:26 devstack cinder-volume[82102]: INFO cinder.image.image_utils [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Converted 1024.00 MB image at 495.72 MB/s
Apr 02 10:33:26 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86 is being set with open permissions: ugo+rw
Apr 02 10:33:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:26 devstack sudo[89354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86
Apr 02 10:33:26 devstack sudo[89354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:26 devstack sudo[89351]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e8ff5d48-1eee-46f2-b827-38e9b4d0289e tempest-SnapshotDependencyTests-405094569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.442s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:26 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-e8ff5d48-1eee-46f2-b827-38e9b4d0289e tempest-SnapshotDependencyTests-405094569 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:33:26 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-e8ff5d48-1eee-46f2-b827-38e9b4d0289e tempest-SnapshotDependencyTests-405094569 None] Deleted volume successfully.
Apr 02 10:33:26 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-e8ff5d48-1eee-46f2-b827-38e9b4d0289e tempest-SnapshotDependencyTests-405094569 None] Lock "cinder-21563b07-9fd8-4732-af8c-d6f9362c498f-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:33:27 devstack sudo[89354]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86" returned: 0 in 0.477s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:27 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-quobyte-b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86" released by "_copy_volume_from_snapshot" :: held 4.249s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:33:27 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-quobyte-e13a4f71-d447-4af7-b73a-bc2144062689-b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86" released by "_create_volume_from_snapshot" :: held 4.269s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:33:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.277s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:33:27 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1040d18e-a542-4afa-bea0-fb7734a87c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86', 'volume_size': 2, 'snapshot_id': 'e13a4f71-d447-4af7-b73a-bc2144062689'}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:27 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (194e3422-130a-4438-b27e-bac4d0c766b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:27 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Volume volume-b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86 (b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86): created successfully
Apr 02 10:33:27 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (194e3422-130a-4438-b27e-bac4d0c766b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:27 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Flow 'volume_create_manager' (ad2e258c-600b-4ea2-9b88-7b72ec573497) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:33:27 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-99da1be2-0664-4e38-8bec-c262a6a1d092 tempest-VolumesSnapshotTestJSON-821295557 None] Created volume successfully.
Apr 02 10:33:28 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-cfcd2307-149f-46e8-b487-36a5d33efbfe tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "cinder-b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:33:28 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-cfcd2307-149f-46e8-b487-36a5d33efbfe tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:33:28 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-cfcd2307-149f-46e8-b487-36a5d33efbfe tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "cinder-quobyte-b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:33:28 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-cfcd2307-149f-46e8-b487-36a5d33efbfe tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-quobyte-b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86" acquired by "delete_volume" :: waited 0.013s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:33:28 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dae353b-e05e-442c-8a64-9db6aed88e1e]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:33:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cfcd2307-149f-46e8-b487-36a5d33efbfe tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:28 devstack sudo[89359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86
Apr 02 10:33:28 devstack sudo[89359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:28 devstack sudo[89359]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cfcd2307-149f-46e8-b487-36a5d33efbfe tempest-VolumesSnapshotTestJSON-821295557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86" returned: 0 in 0.514s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cfcd2307-149f-46e8-b487-36a5d33efbfe tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:28 devstack sudo[89364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86
Apr 02 10:33:28 devstack sudo[89364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:29 devstack sudo[89364]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cfcd2307-149f-46e8-b487-36a5d33efbfe tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86" returned: 0 in 0.473s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:29 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-cfcd2307-149f-46e8-b487-36a5d33efbfe tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-quobyte-b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86" released by "delete_volume" :: held 1.015s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:33:29 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-cfcd2307-149f-46e8-b487-36a5d33efbfe tempest-VolumesSnapshotTestJSON-821295557 None] Created reservations ['46fde11b-6e23-4379-ae51-c6006bfdaa78', '8cd944e8-7d65-4558-8d3b-f4f9ae1f91d0', '523993af-7167-4b86-9ce3-edfe7ecdb314', '8ffd2778-0b9f-4f9a-a047-9daece5ee540'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:33:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-cfcd2307-149f-46e8-b487-36a5d33efbfe tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:33:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-cfcd2307-149f-46e8-b487-36a5d33efbfe tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:33:29 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-cfcd2307-149f-46e8-b487-36a5d33efbfe tempest-VolumesSnapshotTestJSON-821295557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:33:29 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-cfcd2307-149f-46e8-b487-36a5d33efbfe tempest-VolumesSnapshotTestJSON-821295557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:33:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-cfcd2307-149f-46e8-b487-36a5d33efbfe tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:33:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cfcd2307-149f-46e8-b487-36a5d33efbfe tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:29 devstack sudo[89369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:33:29 devstack sudo[89369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:29 devstack sudo[89369]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-cfcd2307-149f-46e8-b487-36a5d33efbfe tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.429s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:29 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-cfcd2307-149f-46e8-b487-36a5d33efbfe tempest-VolumesSnapshotTestJSON-821295557 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:33:29 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-cfcd2307-149f-46e8-b487-36a5d33efbfe tempest-VolumesSnapshotTestJSON-821295557 None] Deleted volume successfully.
Apr 02 10:33:29 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-cfcd2307-149f-46e8-b487-36a5d33efbfe tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-b4d7cc2d-54db-4e10-a9a4-ac4c5003fa86-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:33:30 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-dbabfb9d-8142-4333-a60d-deb2428b7a98 tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "cinder-e13a4f71-d447-4af7-b73a-bc2144062689-delete_snapshot" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:33:30 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-dbabfb9d-8142-4333-a60d-deb2428b7a98 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-e13a4f71-d447-4af7-b73a-bc2144062689-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:33:30 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-dbabfb9d-8142-4333-a60d-deb2428b7a98 tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "cinder-quobyte-44d349cd-472a-4fc5-9a9b-f1de43f921a6" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:33:30 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-dbabfb9d-8142-4333-a60d-deb2428b7a98 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-quobyte-44d349cd-472a-4fc5-9a9b-f1de43f921a6" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:33:30 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-dbabfb9d-8142-4333-a60d-deb2428b7a98 tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "cinder-quobyte-e13a4f71-d447-4af7-b73a-bc2144062689" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:33:30 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-dbabfb9d-8142-4333-a60d-deb2428b7a98 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-quobyte-e13a4f71-d447-4af7-b73a-bc2144062689" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:33:30 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-dbabfb9d-8142-4333-a60d-deb2428b7a98 tempest-VolumesSnapshotTestJSON-821295557 None] Deleting offline snapshot e13a4f71-d447-4af7-b73a-bc2144062689 of volume 44d349cd-472a-4fc5-9a9b-f1de43f921a6 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:33:30 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-dbabfb9d-8142-4333-a60d-deb2428b7a98 tempest-VolumesSnapshotTestJSON-821295557 None] snapshot_file for this snap is: volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6.e13a4f71-d447-4af7-b73a-bc2144062689 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:33:30 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a536eec4-34e2-44ec-83cb-fd57d053167b]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:33:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-dbabfb9d-8142-4333-a60d-deb2428b7a98 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6.e13a4f71-d447-4af7-b73a-bc2144062689 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:30 devstack sudo[89373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6.e13a4f71-d447-4af7-b73a-bc2144062689
Apr 02 10:33:30 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:31 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-dbabfb9d-8142-4333-a60d-deb2428b7a98 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6.e13a4f71-d447-4af7-b73a-bc2144062689" returned: 0 in 0.561s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:31 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-dbabfb9d-8142-4333-a60d-deb2428b7a98 tempest-VolumesSnapshotTestJSON-821295557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:33:31 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c53fe8-1666-48c9-9bc6-b0427fd51d40]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:33:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-dbabfb9d-8142-4333-a60d-deb2428b7a98 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:31 devstack sudo[89380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6
Apr 02 10:33:31 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:31 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-dbabfb9d-8142-4333-a60d-deb2428b7a98 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6" returned: 0 in 0.602s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-dbabfb9d-8142-4333-a60d-deb2428b7a98 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6.e13a4f71-d447-4af7-b73a-bc2144062689 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:31 devstack sudo[89385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6.e13a4f71-d447-4af7-b73a-bc2144062689
Apr 02 10:33:31 devstack sudo[89385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:32 devstack sudo[89385]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-dbabfb9d-8142-4333-a60d-deb2428b7a98 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6.e13a4f71-d447-4af7-b73a-bc2144062689" returned: 0 in 0.474s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-dbabfb9d-8142-4333-a60d-deb2428b7a98 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6.e13a4f71-d447-4af7-b73a-bc2144062689 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:32 devstack sudo[89390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6.e13a4f71-d447-4af7-b73a-bc2144062689
Apr 02 10:33:32 devstack sudo[89390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:32 devstack sudo[89390]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-dbabfb9d-8142-4333-a60d-deb2428b7a98 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6.e13a4f71-d447-4af7-b73a-bc2144062689" returned: 0 in 0.456s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:32 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-dbabfb9d-8142-4333-a60d-deb2428b7a98 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-quobyte-e13a4f71-d447-4af7-b73a-bc2144062689" released by "_delete_snapshot" :: held 2.156s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:33:32 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-dbabfb9d-8142-4333-a60d-deb2428b7a98 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-quobyte-44d349cd-472a-4fc5-9a9b-f1de43f921a6" released by "delete_snapshot" :: held 2.169s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:33:32 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-dbabfb9d-8142-4333-a60d-deb2428b7a98 tempest-VolumesSnapshotTestJSON-821295557 None] Created reservations ['24090bae-d0d4-4430-90d4-095637a90dd6', '26748a23-70ee-4e4b-b3e2-80bfd9c816da', '7817d279-f521-4533-b5ee-9be34d36b0b8', '98538e6b-f513-4115-a1c3-d8866e6671dd'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:33:32 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-dbabfb9d-8142-4333-a60d-deb2428b7a98 tempest-VolumesSnapshotTestJSON-821295557 None] Delete snapshot completed successfully.
Apr 02 10:33:32 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-dbabfb9d-8142-4333-a60d-deb2428b7a98 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-e13a4f71-d447-4af7-b73a-bc2144062689-delete_snapshot" released by "delete_snapshot" :: held 2.291s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:33:33 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-db7e7bb9-4c5d-4001-92a7-1e7eeeade18a tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "cinder-44d349cd-472a-4fc5-9a9b-f1de43f921a6-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:33:33 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-db7e7bb9-4c5d-4001-92a7-1e7eeeade18a tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-44d349cd-472a-4fc5-9a9b-f1de43f921a6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:33:33 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-db7e7bb9-4c5d-4001-92a7-1e7eeeade18a tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "cinder-quobyte-44d349cd-472a-4fc5-9a9b-f1de43f921a6" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:33:33 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-db7e7bb9-4c5d-4001-92a7-1e7eeeade18a tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-quobyte-44d349cd-472a-4fc5-9a9b-f1de43f921a6" acquired by "delete_volume" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:33:33 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3d81c0-64be-43cc-8f0d-cc16bc41ddfb]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:33:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-db7e7bb9-4c5d-4001-92a7-1e7eeeade18a tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:33 devstack sudo[89394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6
Apr 02 10:33:33 devstack sudo[89394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:34 devstack sudo[89394]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-db7e7bb9-4c5d-4001-92a7-1e7eeeade18a tempest-VolumesSnapshotTestJSON-821295557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6" returned: 0 in 0.484s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-db7e7bb9-4c5d-4001-92a7-1e7eeeade18a tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:34 devstack sudo[89399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6
Apr 02 10:33:34 devstack sudo[89399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:34 devstack sudo[89399]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-db7e7bb9-4c5d-4001-92a7-1e7eeeade18a tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-44d349cd-472a-4fc5-9a9b-f1de43f921a6" returned: 0 in 0.444s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:34 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-db7e7bb9-4c5d-4001-92a7-1e7eeeade18a tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-quobyte-44d349cd-472a-4fc5-9a9b-f1de43f921a6" released by "delete_volume" :: held 0.962s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:33:34 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-db7e7bb9-4c5d-4001-92a7-1e7eeeade18a tempest-VolumesSnapshotTestJSON-821295557 None] Created reservations ['ada4a044-9cfa-41bf-848b-e7035742544d', '3094497a-91e5-4f70-bb00-6befef2f40e9', '8dd07540-2359-42c0-8a43-78e913682b37', '6f400d6d-e186-47a1-a2bb-be0e9206b725'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:33:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-db7e7bb9-4c5d-4001-92a7-1e7eeeade18a tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:33:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-db7e7bb9-4c5d-4001-92a7-1e7eeeade18a tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:33:34 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-db7e7bb9-4c5d-4001-92a7-1e7eeeade18a tempest-VolumesSnapshotTestJSON-821295557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:33:34 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-db7e7bb9-4c5d-4001-92a7-1e7eeeade18a tempest-VolumesSnapshotTestJSON-821295557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:33:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-db7e7bb9-4c5d-4001-92a7-1e7eeeade18a tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:33:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-db7e7bb9-4c5d-4001-92a7-1e7eeeade18a tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:34 devstack sudo[89402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:33:34 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:35 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-db7e7bb9-4c5d-4001-92a7-1e7eeeade18a tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.406s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:35 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-db7e7bb9-4c5d-4001-92a7-1e7eeeade18a tempest-VolumesSnapshotTestJSON-821295557 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:33:35 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-db7e7bb9-4c5d-4001-92a7-1e7eeeade18a tempest-VolumesSnapshotTestJSON-821295557 None] Deleted volume successfully.
Apr 02 10:33:35 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-db7e7bb9-4c5d-4001-92a7-1e7eeeade18a tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-44d349cd-472a-4fc5-9a9b-f1de43f921a6-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:33:36 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-816f3dea-0d01-4201-93be-a6228c47facf tempest-VolumesSnapshotTestJSON-821295557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:33:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-816f3dea-0d01-4201-93be-a6228c47facf tempest-VolumesSnapshotTestJSON-821295557 None] Flow 'volume_create_manager' (5c04fabc-26c0-4db4-b6ba-889408c0c9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:33:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-816f3dea-0d01-4201-93be-a6228c47facf tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b8e337-3821-4d03-82df-bb82a626e925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-816f3dea-0d01-4201-93be-a6228c47facf tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b8e337-3821-4d03-82df-bb82a626e925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-614442772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c356ec1-32bc-4e44-a74b-717ec1294ae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8924dff136241a2836da95789bd4859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:33:36Z,use_quota=True,user_id='9af7926171e44d8788c8a5dfb8ac1f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-816f3dea-0d01-4201-93be-a6228c47facf tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a7e4ed-bf6b-4dcc-a7d3-aea9679b20b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-816f3dea-0d01-4201-93be-a6228c47facf tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a7e4ed-bf6b-4dcc-a7d3-aea9679b20b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-816f3dea-0d01-4201-93be-a6228c47facf tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a8850a3-0ed5-4ac8-a55b-c7af9d480e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-816f3dea-0d01-4201-93be-a6228c47facf tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a8850a3-0ed5-4ac8-a55b-c7af9d480e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c356ec1-32bc-4e44-a74b-717ec1294ae3', 'volume_name': 'volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-816f3dea-0d01-4201-93be-a6228c47facf tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e51a27a3-7ef0-4f90-a5e2-50cb3d478562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-816f3dea-0d01-4201-93be-a6228c47facf tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e51a27a3-7ef0-4f90-a5e2-50cb3d478562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-816f3dea-0d01-4201-93be-a6228c47facf tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6fce7a-0305-474a-ab01-695bddd27989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:36 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-816f3dea-0d01-4201-93be-a6228c47facf tempest-VolumesSnapshotTestJSON-821295557 None] Volume 4c356ec1-32bc-4e44-a74b-717ec1294ae3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3', 'volume_size': 1}
Apr 02 10:33:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-816f3dea-0d01-4201-93be-a6228c47facf tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:33:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-816f3dea-0d01-4201-93be-a6228c47facf tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:33:36 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-816f3dea-0d01-4201-93be-a6228c47facf tempest-VolumesSnapshotTestJSON-821295557 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-614442772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c356ec1-32bc-4e44-a74b-717ec1294ae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8924dff136241a2836da95789bd4859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:33:36Z,use_quota=True,user_id='9af7926171e44d8788c8a5dfb8ac1f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:33:36 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-816f3dea-0d01-4201-93be-a6228c47facf tempest-VolumesSnapshotTestJSON-821295557 None] Creating volume 4c356ec1-32bc-4e44-a74b-717ec1294ae3 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:33:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-816f3dea-0d01-4201-93be-a6228c47facf tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:33:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-816f3dea-0d01-4201-93be-a6228c47facf tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:33:36 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-816f3dea-0d01-4201-93be-a6228c47facf tempest-VolumesSnapshotTestJSON-821295557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:33:36 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-816f3dea-0d01-4201-93be-a6228c47facf tempest-VolumesSnapshotTestJSON-821295557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:33:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-816f3dea-0d01-4201-93be-a6228c47facf tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:33:36 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-816f3dea-0d01-4201-93be-a6228c47facf tempest-VolumesSnapshotTestJSON-821295557 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:33:36 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-816f3dea-0d01-4201-93be-a6228c47facf tempest-VolumesSnapshotTestJSON-821295557 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:33:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-816f3dea-0d01-4201-93be-a6228c47facf tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:36 devstack sudo[89405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3 1073741824
Apr 02 10:33:36 devstack sudo[89405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:36 devstack sudo[89405]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-816f3dea-0d01-4201-93be-a6228c47facf tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3 1073741824" returned: 0 in 0.483s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-816f3dea-0d01-4201-93be-a6228c47facf tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:36 devstack sudo[89410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3
Apr 02 10:33:36 devstack sudo[89410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:37 devstack sudo[89410]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-816f3dea-0d01-4201-93be-a6228c47facf tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3" returned: 0 in 0.398s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:37 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-816f3dea-0d01-4201-93be-a6228c47facf tempest-VolumesSnapshotTestJSON-821295557 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:33:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-816f3dea-0d01-4201-93be-a6228c47facf tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:33:37 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-816f3dea-0d01-4201-93be-a6228c47facf tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6fce7a-0305-474a-ab01-695bddd27989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:37 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-816f3dea-0d01-4201-93be-a6228c47facf tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0e730a-5cf2-46b8-9eb4-4f164dc1170c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:37 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-816f3dea-0d01-4201-93be-a6228c47facf tempest-VolumesSnapshotTestJSON-821295557 None] Volume volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3 (4c356ec1-32bc-4e44-a74b-717ec1294ae3): created successfully
Apr 02 10:33:37 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-816f3dea-0d01-4201-93be-a6228c47facf tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0e730a-5cf2-46b8-9eb4-4f164dc1170c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:37 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-816f3dea-0d01-4201-93be-a6228c47facf tempest-VolumesSnapshotTestJSON-821295557 None] Flow 'volume_create_manager' (5c04fabc-26c0-4db4-b6ba-889408c0c9c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:33:37 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-816f3dea-0d01-4201-93be-a6228c47facf tempest-VolumesSnapshotTestJSON-821295557 None] Created volume successfully.
Apr 02 10:33:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-28de8f1b-81ac-47ba-8da3-d2325d318b21 tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:33:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-28de8f1b-81ac-47ba-8da3-d2325d318b21 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:33:37 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-28de8f1b-81ac-47ba-8da3-d2325d318b21 tempest-VolumesSnapshotTestJSON-821295557 None] Creating offline snapshot 940f562f-95b5-4792-8d0a-de072fd0754c of volume 4c356ec1-32bc-4e44-a74b-717ec1294ae3 {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:33:37 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b03512-4c5d-43a1-910c-19ee0e011752]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:33:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-28de8f1b-81ac-47ba-8da3-d2325d318b21 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:37 devstack sudo[89413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3
Apr 02 10:33:37 devstack sudo[89413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:37 devstack sudo[89413]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-28de8f1b-81ac-47ba-8da3-d2325d318b21 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3" returned: 0 in 0.481s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-28de8f1b-81ac-47ba-8da3-d2325d318b21 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3.940f562f-95b5-4792-8d0a-de072fd0754c 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:37 devstack sudo[89418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3.940f562f-95b5-4792-8d0a-de072fd0754c 1G
Apr 02 10:33:37 devstack sudo[89418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:38 devstack sudo[89418]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-28de8f1b-81ac-47ba-8da3-d2325d318b21 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3.940f562f-95b5-4792-8d0a-de072fd0754c 1G" returned: 0 in 0.531s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-28de8f1b-81ac-47ba-8da3-d2325d318b21 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3.940f562f-95b5-4792-8d0a-de072fd0754c {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:38 devstack sudo[89423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3.940f562f-95b5-4792-8d0a-de072fd0754c
Apr 02 10:33:38 devstack sudo[89423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:38 devstack sudo[89423]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-28de8f1b-81ac-47ba-8da3-d2325d318b21 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3.940f562f-95b5-4792-8d0a-de072fd0754c" returned: 0 in 0.434s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:38 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-28de8f1b-81ac-47ba-8da3-d2325d318b21 tempest-VolumesSnapshotTestJSON-821295557 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3.940f562f-95b5-4792-8d0a-de072fd0754c is being set with open permissions: ugo+rw
Apr 02 10:33:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-28de8f1b-81ac-47ba-8da3-d2325d318b21 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3.940f562f-95b5-4792-8d0a-de072fd0754c {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:38 devstack sudo[89428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3.940f562f-95b5-4792-8d0a-de072fd0754c
Apr 02 10:33:38 devstack sudo[89428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:39 devstack sudo[89428]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-28de8f1b-81ac-47ba-8da3-d2325d318b21 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3.940f562f-95b5-4792-8d0a-de072fd0754c" returned: 0 in 0.418s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-28de8f1b-81ac-47ba-8da3-d2325d318b21 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:39 devstack sudo[89431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3.info
Apr 02 10:33:39 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:39 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-28de8f1b-81ac-47ba-8da3-d2325d318b21 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3.info" returned: 0 in 0.427s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:39 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-28de8f1b-81ac-47ba-8da3-d2325d318b21 tempest-VolumesSnapshotTestJSON-821295557 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3.info is being set with open permissions: ugo+rw
Apr 02 10:33:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-28de8f1b-81ac-47ba-8da3-d2325d318b21 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:39 devstack sudo[89434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3.info
Apr 02 10:33:39 devstack sudo[89434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:40 devstack sudo[89434]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-28de8f1b-81ac-47ba-8da3-d2325d318b21 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3.info" returned: 0 in 0.438s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-28de8f1b-81ac-47ba-8da3-d2325d318b21 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.788s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:33:40 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-28de8f1b-81ac-47ba-8da3-d2325d318b21 tempest-VolumesSnapshotTestJSON-821295557 None] Create snapshot completed successfully
Apr 02 10:33:40 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:33:40 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Flow 'volume_create_manager' (67d90775-b815-4268-a488-d8c8f7dc78d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:33:40 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637280f0-e91a-4ca8-8395-397662ec31d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:40 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637280f0-e91a-4ca8-8395-397662ec31d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1944167755',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=419f43bf-24cb-4948-bc4f-472d24afa101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8924dff136241a2836da95789bd4859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=940f562f-95b5-4792-8d0a-de072fd0754c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:33:41Z,use_quota=True,user_id='9af7926171e44d8788c8a5dfb8ac1f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:40 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e53aa84-f9c9-49fc-a27d-2f3de79edfb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:40 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e53aa84-f9c9-49fc-a27d-2f3de79edfb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:40 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e08e9e33-cb15-4032-b6dd-feea51647265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:40 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e08e9e33-cb15-4032-b6dd-feea51647265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '419f43bf-24cb-4948-bc4f-472d24afa101', 'volume_name': 'volume-419f43bf-24cb-4948-bc4f-472d24afa101', 'volume_size': 1, 'snapshot_id': '940f562f-95b5-4792-8d0a-de072fd0754c'}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:40 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7751b75-3aef-4dc4-aabb-d32863c0b5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:40 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7751b75-3aef-4dc4-aabb-d32863c0b5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:40 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12e08b40-7be3-4f23-ae0a-047d35cb89d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:40 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Volume 419f43bf-24cb-4948-bc4f-472d24afa101: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-419f43bf-24cb-4948-bc4f-472d24afa101', 'volume_size': 1, 'snapshot_id': '940f562f-95b5-4792-8d0a-de072fd0754c'}
Apr 02 10:33:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:33:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:33:40 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "cinder-quobyte-940f562f-95b5-4792-8d0a-de072fd0754c-419f43bf-24cb-4948-bc4f-472d24afa101" by "_create_volume_from_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:33:40 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-quobyte-940f562f-95b5-4792-8d0a-de072fd0754c-419f43bf-24cb-4948-bc4f-472d24afa101" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:33:40 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Creating volume 419f43bf-24cb-4948-bc4f-472d24afa101 from snapshot 940f562f-95b5-4792-8d0a-de072fd0754c {{(pid=82102) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 02 10:33:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:33:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:33:40 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:33:40 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:33:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:33:40 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:33:40 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "cinder-quobyte-419f43bf-24cb-4948-bc4f-472d24afa101" by "_copy_volume_from_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:33:40 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-quobyte-419f43bf-24cb-4948-bc4f-472d24afa101" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:33:40 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] snapshot: 940f562f-95b5-4792-8d0a-de072fd0754c, volume: 419f43bf-24cb-4948-bc4f-472d24afa101,  {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 02 10:33:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:33:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:33:40 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:33:40 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:33:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:33:40 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[76167fd5-806e-4428-a815-02220c0a6031]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:33:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3.940f562f-95b5-4792-8d0a-de072fd0754c {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:40 devstack sudo[89443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3.940f562f-95b5-4792-8d0a-de072fd0754c
Apr 02 10:33:40 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:41 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3.940f562f-95b5-4792-8d0a-de072fd0754c" returned: 0 in 0.574s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:41 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:33:41 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3 {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 02 10:33:41 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Creating direct copy from snapshot {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 02 10:33:41 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdd5f64-50ee-454c-93a3-ffa8770c67d3]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:33:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:41 devstack sudo[89449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3
Apr 02 10:33:41 devstack sudo[89449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:41 devstack sudo[89449]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3" returned: 0 in 0.493s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:41 devstack cinder-volume[82102]: DEBUG cinder.utils [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Path /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-419f43bf-24cb-4948-bc4f-472d24afa101 not found in is_blk_device check {{(pid=82102) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 02 10:33:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-419f43bf-24cb-4948-bc4f-472d24afa101 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:41 devstack sudo[89454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-419f43bf-24cb-4948-bc4f-472d24afa101
Apr 02 10:33:41 devstack sudo[89454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:43 devstack sudo[89454]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-419f43bf-24cb-4948-bc4f-472d24afa101" returned: 0 in 1.905s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:43 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05e39e2-c12c-46ae-83ce-2bbfe6010e07]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:33:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:43 devstack sudo[89466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3
Apr 02 10:33:43 devstack sudo[89466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:44 devstack sudo[89466]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:44 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3" returned: 0 in 0.575s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:44 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Image conversion details: src /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3, size 1024.00 MB, duration 1.91 sec, destination /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-419f43bf-24cb-4948-bc4f-472d24afa101 {{(pid=82102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 02 10:33:44 devstack cinder-volume[82102]: INFO cinder.image.image_utils [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Converted 1024.00 MB image at 537.18 MB/s
Apr 02 10:33:44 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-419f43bf-24cb-4948-bc4f-472d24afa101 is being set with open permissions: ugo+rw
Apr 02 10:33:44 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-419f43bf-24cb-4948-bc4f-472d24afa101 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:44 devstack sudo[89471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-419f43bf-24cb-4948-bc4f-472d24afa101
Apr 02 10:33:44 devstack sudo[89471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:44 devstack sudo[89471]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:44 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-419f43bf-24cb-4948-bc4f-472d24afa101" returned: 0 in 0.390s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:44 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-quobyte-419f43bf-24cb-4948-bc4f-472d24afa101" released by "_copy_volume_from_snapshot" :: held 3.992s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:33:44 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-quobyte-940f562f-95b5-4792-8d0a-de072fd0754c-419f43bf-24cb-4948-bc4f-472d24afa101" released by "_create_volume_from_snapshot" :: held 4.008s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:33:44 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.016s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:33:44 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12e08b40-7be3-4f23-ae0a-047d35cb89d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-419f43bf-24cb-4948-bc4f-472d24afa101', 'volume_size': 1, 'snapshot_id': '940f562f-95b5-4792-8d0a-de072fd0754c'}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:44 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01b6a228-bfb1-47bd-abbf-2d0f3364e4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:44 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Volume volume-419f43bf-24cb-4948-bc4f-472d24afa101 (419f43bf-24cb-4948-bc4f-472d24afa101): created successfully
Apr 02 10:33:44 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01b6a228-bfb1-47bd-abbf-2d0f3364e4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:44 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Flow 'volume_create_manager' (67d90775-b815-4268-a488-d8c8f7dc78d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:33:44 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-7c5fabc5-57ad-47a8-8730-d023d0a8b1d5 tempest-VolumesSnapshotTestJSON-821295557 None] Created volume successfully.
Apr 02 10:33:45 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-fbe34472-f3ea-4803-9413-d78400daa653 tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "cinder-419f43bf-24cb-4948-bc4f-472d24afa101-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:33:45 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-fbe34472-f3ea-4803-9413-d78400daa653 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-419f43bf-24cb-4948-bc4f-472d24afa101-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:33:45 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-fbe34472-f3ea-4803-9413-d78400daa653 tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "cinder-quobyte-419f43bf-24cb-4948-bc4f-472d24afa101" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:33:45 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-fbe34472-f3ea-4803-9413-d78400daa653 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-quobyte-419f43bf-24cb-4948-bc4f-472d24afa101" acquired by "delete_volume" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:33:45 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5d6fd9-e83d-461a-b979-e8c783d741e2]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:33:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-fbe34472-f3ea-4803-9413-d78400daa653 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-419f43bf-24cb-4948-bc4f-472d24afa101 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:45 devstack sudo[89474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-419f43bf-24cb-4948-bc4f-472d24afa101
Apr 02 10:33:45 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:45 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-fbe34472-f3ea-4803-9413-d78400daa653 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-419f43bf-24cb-4948-bc4f-472d24afa101" returned: 0 in 0.434s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-fbe34472-f3ea-4803-9413-d78400daa653 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-419f43bf-24cb-4948-bc4f-472d24afa101 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:45 devstack sudo[89479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-419f43bf-24cb-4948-bc4f-472d24afa101
Apr 02 10:33:45 devstack sudo[89479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:45 devstack sudo[89479]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-fbe34472-f3ea-4803-9413-d78400daa653 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-419f43bf-24cb-4948-bc4f-472d24afa101" returned: 0 in 0.410s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:45 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-fbe34472-f3ea-4803-9413-d78400daa653 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-quobyte-419f43bf-24cb-4948-bc4f-472d24afa101" released by "delete_volume" :: held 0.872s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:33:46 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-fbe34472-f3ea-4803-9413-d78400daa653 tempest-VolumesSnapshotTestJSON-821295557 None] Created reservations ['a993ad50-a312-43b8-8125-5534437671bd', '87908600-2546-4fa3-a0e3-14403ed33088', '0f78fe1f-7f0e-49bc-a1a0-bf576d0178e4', 'fc089b33-654a-4da5-88bd-b18345a7a039'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:33:46 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-fbe34472-f3ea-4803-9413-d78400daa653 tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:33:46 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-fbe34472-f3ea-4803-9413-d78400daa653 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:33:46 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-fbe34472-f3ea-4803-9413-d78400daa653 tempest-VolumesSnapshotTestJSON-821295557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:33:46 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-fbe34472-f3ea-4803-9413-d78400daa653 tempest-VolumesSnapshotTestJSON-821295557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:33:46 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-fbe34472-f3ea-4803-9413-d78400daa653 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:33:46 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-fbe34472-f3ea-4803-9413-d78400daa653 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:46 devstack sudo[89482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:33:46 devstack sudo[89482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:46 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a356dd20-d947-4d6e-b430-2ffea9119ba0 tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "cinder-940f562f-95b5-4792-8d0a-de072fd0754c-delete_snapshot" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:33:46 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a356dd20-d947-4d6e-b430-2ffea9119ba0 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-940f562f-95b5-4792-8d0a-de072fd0754c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:33:46 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a356dd20-d947-4d6e-b430-2ffea9119ba0 tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "cinder-quobyte-4c356ec1-32bc-4e44-a74b-717ec1294ae3" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:33:46 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a356dd20-d947-4d6e-b430-2ffea9119ba0 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-quobyte-4c356ec1-32bc-4e44-a74b-717ec1294ae3" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:33:46 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a356dd20-d947-4d6e-b430-2ffea9119ba0 tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "cinder-quobyte-940f562f-95b5-4792-8d0a-de072fd0754c" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:33:46 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a356dd20-d947-4d6e-b430-2ffea9119ba0 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-quobyte-940f562f-95b5-4792-8d0a-de072fd0754c" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:33:46 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-a356dd20-d947-4d6e-b430-2ffea9119ba0 tempest-VolumesSnapshotTestJSON-821295557 None] Deleting offline snapshot 940f562f-95b5-4792-8d0a-de072fd0754c of volume 4c356ec1-32bc-4e44-a74b-717ec1294ae3 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:33:46 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-a356dd20-d947-4d6e-b430-2ffea9119ba0 tempest-VolumesSnapshotTestJSON-821295557 None] snapshot_file for this snap is: volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3.940f562f-95b5-4792-8d0a-de072fd0754c {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:33:46 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[02df8082-d4c8-4dfe-b084-40b60a2c8fe2]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:33:46 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a356dd20-d947-4d6e-b430-2ffea9119ba0 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3.940f562f-95b5-4792-8d0a-de072fd0754c {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:46 devstack sudo[89484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3.940f562f-95b5-4792-8d0a-de072fd0754c
Apr 02 10:33:46 devstack sudo[89484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:46 devstack sudo[89482]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:46 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-fbe34472-f3ea-4803-9413-d78400daa653 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.419s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:46 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-fbe34472-f3ea-4803-9413-d78400daa653 tempest-VolumesSnapshotTestJSON-821295557 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:33:46 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-fbe34472-f3ea-4803-9413-d78400daa653 tempest-VolumesSnapshotTestJSON-821295557 None] Deleted volume successfully.
Apr 02 10:33:46 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-fbe34472-f3ea-4803-9413-d78400daa653 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-419f43bf-24cb-4948-bc4f-472d24afa101-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:33:46 devstack sudo[89484]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:46 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a356dd20-d947-4d6e-b430-2ffea9119ba0 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3.940f562f-95b5-4792-8d0a-de072fd0754c" returned: 0 in 0.447s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:46 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-a356dd20-d947-4d6e-b430-2ffea9119ba0 tempest-VolumesSnapshotTestJSON-821295557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:33:46 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c6ec51-5bef-4075-b061-c1d6e60b97cc]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:33:46 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a356dd20-d947-4d6e-b430-2ffea9119ba0 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:46 devstack sudo[89490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3
Apr 02 10:33:46 devstack sudo[89490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:47 devstack sudo[89490]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a356dd20-d947-4d6e-b430-2ffea9119ba0 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3" returned: 0 in 0.423s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a356dd20-d947-4d6e-b430-2ffea9119ba0 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3.940f562f-95b5-4792-8d0a-de072fd0754c {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:47 devstack sudo[89495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3.940f562f-95b5-4792-8d0a-de072fd0754c
Apr 02 10:33:47 devstack sudo[89495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:47 devstack sudo[89495]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a356dd20-d947-4d6e-b430-2ffea9119ba0 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3.940f562f-95b5-4792-8d0a-de072fd0754c" returned: 0 in 0.438s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a356dd20-d947-4d6e-b430-2ffea9119ba0 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3.940f562f-95b5-4792-8d0a-de072fd0754c {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:47 devstack sudo[89500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3.940f562f-95b5-4792-8d0a-de072fd0754c
Apr 02 10:33:47 devstack sudo[89500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:47 devstack sudo[89500]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a356dd20-d947-4d6e-b430-2ffea9119ba0 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3.940f562f-95b5-4792-8d0a-de072fd0754c" returned: 0 in 0.390s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:48 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a356dd20-d947-4d6e-b430-2ffea9119ba0 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-quobyte-940f562f-95b5-4792-8d0a-de072fd0754c" released by "_delete_snapshot" :: held 1.761s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:33:48 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a356dd20-d947-4d6e-b430-2ffea9119ba0 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-quobyte-4c356ec1-32bc-4e44-a74b-717ec1294ae3" released by "delete_snapshot" :: held 1.773s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:33:48 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-a356dd20-d947-4d6e-b430-2ffea9119ba0 tempest-VolumesSnapshotTestJSON-821295557 None] Created reservations ['9a0d6253-a84c-4efa-8207-be4a3ce71feb', '9073156c-f29e-485a-8f44-380012186d86', '4d880d45-8257-41c0-9540-2ff44691ef64', '13413ac2-4b52-4796-884b-e8a3ba74f969'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:33:48 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-a356dd20-d947-4d6e-b430-2ffea9119ba0 tempest-VolumesSnapshotTestJSON-821295557 None] Delete snapshot completed successfully.
Apr 02 10:33:48 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a356dd20-d947-4d6e-b430-2ffea9119ba0 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-940f562f-95b5-4792-8d0a-de072fd0754c-delete_snapshot" released by "delete_snapshot" :: held 1.858s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:33:48 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5d302037-7380-42a3-adb4-3b254d4f94a6 tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "cinder-4c356ec1-32bc-4e44-a74b-717ec1294ae3-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:33:48 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5d302037-7380-42a3-adb4-3b254d4f94a6 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-4c356ec1-32bc-4e44-a74b-717ec1294ae3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:33:48 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5d302037-7380-42a3-adb4-3b254d4f94a6 tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "cinder-quobyte-4c356ec1-32bc-4e44-a74b-717ec1294ae3" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:33:48 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5d302037-7380-42a3-adb4-3b254d4f94a6 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-quobyte-4c356ec1-32bc-4e44-a74b-717ec1294ae3" acquired by "delete_volume" :: waited 0.016s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:33:48 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2e279a-d332-4151-b159-5cc98845f232]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:33:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5d302037-7380-42a3-adb4-3b254d4f94a6 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:48 devstack sudo[89537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3
Apr 02 10:33:48 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:48 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5d302037-7380-42a3-adb4-3b254d4f94a6 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3" returned: 0 in 0.455s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5d302037-7380-42a3-adb4-3b254d4f94a6 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:48 devstack sudo[89542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3
Apr 02 10:33:48 devstack sudo[89542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:49 devstack sudo[89542]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5d302037-7380-42a3-adb4-3b254d4f94a6 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4c356ec1-32bc-4e44-a74b-717ec1294ae3" returned: 0 in 0.403s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:49 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5d302037-7380-42a3-adb4-3b254d4f94a6 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-quobyte-4c356ec1-32bc-4e44-a74b-717ec1294ae3" released by "delete_volume" :: held 0.892s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:33:49 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-5d302037-7380-42a3-adb4-3b254d4f94a6 tempest-VolumesSnapshotTestJSON-821295557 None] Created reservations ['7079cf72-fcdd-4918-be42-7c8da512d94b', '03323239-a774-4c66-a797-0fe6506628bb', 'b586eee6-1bc9-48da-bae3-bc21125663a9', 'a250b361-784c-441b-85d8-7b2496b405c8'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:33:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5d302037-7380-42a3-adb4-3b254d4f94a6 tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:33:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5d302037-7380-42a3-adb4-3b254d4f94a6 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:33:49 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5d302037-7380-42a3-adb4-3b254d4f94a6 tempest-VolumesSnapshotTestJSON-821295557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:33:49 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5d302037-7380-42a3-adb4-3b254d4f94a6 tempest-VolumesSnapshotTestJSON-821295557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:33:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5d302037-7380-42a3-adb4-3b254d4f94a6 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:33:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5d302037-7380-42a3-adb4-3b254d4f94a6 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:49 devstack sudo[89545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:33:49 devstack sudo[89545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:49 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-fdafd4fa-2116-48bb-809e-2f6cdb287f73 tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "cinder-9be83004-7563-4823-a6bd-bff887626070-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:33:49 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-fdafd4fa-2116-48bb-809e-2f6cdb287f73 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-9be83004-7563-4823-a6bd-bff887626070-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:33:49 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-fdafd4fa-2116-48bb-809e-2f6cdb287f73 tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "cinder-quobyte-9be83004-7563-4823-a6bd-bff887626070" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:33:49 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-fdafd4fa-2116-48bb-809e-2f6cdb287f73 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-quobyte-9be83004-7563-4823-a6bd-bff887626070" acquired by "delete_volume" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:33:49 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f5249e-b0da-4610-a9b0-0ce2b10b7081]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:33:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-fdafd4fa-2116-48bb-809e-2f6cdb287f73 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:49 devstack sudo[89547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070
Apr 02 10:33:49 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:49 devstack sudo[89545]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5d302037-7380-42a3-adb4-3b254d4f94a6 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.403s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:49 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-5d302037-7380-42a3-adb4-3b254d4f94a6 tempest-VolumesSnapshotTestJSON-821295557 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:33:49 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-5d302037-7380-42a3-adb4-3b254d4f94a6 tempest-VolumesSnapshotTestJSON-821295557 None] Deleted volume successfully.
Apr 02 10:33:49 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5d302037-7380-42a3-adb4-3b254d4f94a6 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-4c356ec1-32bc-4e44-a74b-717ec1294ae3-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:33:50 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-fdafd4fa-2116-48bb-809e-2f6cdb287f73 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070" returned: 0 in 0.524s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-fdafd4fa-2116-48bb-809e-2f6cdb287f73 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:50 devstack sudo[89553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070
Apr 02 10:33:50 devstack sudo[89553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:50 devstack sudo[89553]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-fdafd4fa-2116-48bb-809e-2f6cdb287f73 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9be83004-7563-4823-a6bd-bff887626070" returned: 0 in 0.415s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:50 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-fdafd4fa-2116-48bb-809e-2f6cdb287f73 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-quobyte-9be83004-7563-4823-a6bd-bff887626070" released by "delete_volume" :: held 0.970s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:33:50 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-fdafd4fa-2116-48bb-809e-2f6cdb287f73 tempest-VolumesSnapshotTestJSON-821295557 None] Created reservations ['0194aeb5-a9a8-4377-9790-f2265d81ec3c', '3fc87d70-35de-473a-9e1f-34ee0f1f84f1', '5cd36e53-e9c1-45be-bf0e-5ab8891c2db1', '2b1b196f-8585-4be4-b898-183e477293b9'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:33:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-fdafd4fa-2116-48bb-809e-2f6cdb287f73 tempest-VolumesSnapshotTestJSON-821295557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:33:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-fdafd4fa-2116-48bb-809e-2f6cdb287f73 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:33:50 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-fdafd4fa-2116-48bb-809e-2f6cdb287f73 tempest-VolumesSnapshotTestJSON-821295557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:33:50 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-fdafd4fa-2116-48bb-809e-2f6cdb287f73 tempest-VolumesSnapshotTestJSON-821295557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:33:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-fdafd4fa-2116-48bb-809e-2f6cdb287f73 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:33:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-fdafd4fa-2116-48bb-809e-2f6cdb287f73 tempest-VolumesSnapshotTestJSON-821295557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:50 devstack sudo[89556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:33:50 devstack sudo[89556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:51 devstack sudo[89556]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-fdafd4fa-2116-48bb-809e-2f6cdb287f73 tempest-VolumesSnapshotTestJSON-821295557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.400s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:51 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-fdafd4fa-2116-48bb-809e-2f6cdb287f73 tempest-VolumesSnapshotTestJSON-821295557 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:33:51 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-fdafd4fa-2116-48bb-809e-2f6cdb287f73 tempest-VolumesSnapshotTestJSON-821295557 None] Deleted volume successfully.
Apr 02 10:33:51 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-fdafd4fa-2116-48bb-809e-2f6cdb287f73 tempest-VolumesSnapshotTestJSON-821295557 None] Lock "cinder-9be83004-7563-4823-a6bd-bff887626070-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:33:55 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-362eeef0-01e9-412c-a068-3713d4a84721 tempest-VolumeDependencyTests-430671456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:33:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-362eeef0-01e9-412c-a068-3713d4a84721 tempest-VolumeDependencyTests-430671456 None] Flow 'volume_create_manager' (498ab7a5-388d-44f3-804f-236c8a2379af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:33:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-362eeef0-01e9-412c-a068-3713d4a84721 tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ef73379-c8ff-4695-8f34-e5f3d6c91d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-362eeef0-01e9-412c-a068-3713d4a84721 tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ef73379-c8ff-4695-8f34-e5f3d6c91d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1307638553',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48bd39b2-235e-4f68-84e5-550b7d72a86f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f7585d194e46719326ebb67041f04c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:33:56Z,use_quota=True,user_id='fd25044b54d84f9a884ab18a9aef2635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-362eeef0-01e9-412c-a068-3713d4a84721 tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2226b4d-6d16-493e-9998-7531f4e72e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-362eeef0-01e9-412c-a068-3713d4a84721 tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2226b4d-6d16-493e-9998-7531f4e72e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-362eeef0-01e9-412c-a068-3713d4a84721 tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d037da7-0717-42f2-b2df-7b5362703d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-362eeef0-01e9-412c-a068-3713d4a84721 tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d037da7-0717-42f2-b2df-7b5362703d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48bd39b2-235e-4f68-84e5-550b7d72a86f', 'volume_name': 'volume-48bd39b2-235e-4f68-84e5-550b7d72a86f', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-362eeef0-01e9-412c-a068-3713d4a84721 tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490e77f8-c059-4fdb-b24e-4bb265b80b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-362eeef0-01e9-412c-a068-3713d4a84721 tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490e77f8-c059-4fdb-b24e-4bb265b80b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:55 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-362eeef0-01e9-412c-a068-3713d4a84721 tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1d785a6-8a24-4ff5-9352-0cabab2dd09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:55 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-362eeef0-01e9-412c-a068-3713d4a84721 tempest-VolumeDependencyTests-430671456 None] Volume 48bd39b2-235e-4f68-84e5-550b7d72a86f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48bd39b2-235e-4f68-84e5-550b7d72a86f', 'volume_size': 1}
Apr 02 10:33:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-362eeef0-01e9-412c-a068-3713d4a84721 tempest-VolumeDependencyTests-430671456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:33:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-362eeef0-01e9-412c-a068-3713d4a84721 tempest-VolumeDependencyTests-430671456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:33:55 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-362eeef0-01e9-412c-a068-3713d4a84721 tempest-VolumeDependencyTests-430671456 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1307638553',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48bd39b2-235e-4f68-84e5-550b7d72a86f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f7585d194e46719326ebb67041f04c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:33:56Z,use_quota=True,user_id='fd25044b54d84f9a884ab18a9aef2635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:33:55 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-362eeef0-01e9-412c-a068-3713d4a84721 tempest-VolumeDependencyTests-430671456 None] Creating volume 48bd39b2-235e-4f68-84e5-550b7d72a86f {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:33:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-362eeef0-01e9-412c-a068-3713d4a84721 tempest-VolumeDependencyTests-430671456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:33:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-362eeef0-01e9-412c-a068-3713d4a84721 tempest-VolumeDependencyTests-430671456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:33:55 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-362eeef0-01e9-412c-a068-3713d4a84721 tempest-VolumeDependencyTests-430671456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:33:55 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-362eeef0-01e9-412c-a068-3713d4a84721 tempest-VolumeDependencyTests-430671456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:33:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-362eeef0-01e9-412c-a068-3713d4a84721 tempest-VolumeDependencyTests-430671456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:33:55 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-362eeef0-01e9-412c-a068-3713d4a84721 tempest-VolumeDependencyTests-430671456 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:33:55 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-362eeef0-01e9-412c-a068-3713d4a84721 tempest-VolumeDependencyTests-430671456 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:33:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-362eeef0-01e9-412c-a068-3713d4a84721 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:55 devstack sudo[89563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f 1073741824
Apr 02 10:33:55 devstack sudo[89563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:56 devstack sudo[89563]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-362eeef0-01e9-412c-a068-3713d4a84721 tempest-VolumeDependencyTests-430671456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f 1073741824" returned: 0 in 0.489s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-362eeef0-01e9-412c-a068-3713d4a84721 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:56 devstack sudo[89568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f
Apr 02 10:33:56 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:56 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-362eeef0-01e9-412c-a068-3713d4a84721 tempest-VolumeDependencyTests-430671456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f" returned: 0 in 0.446s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:56 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-362eeef0-01e9-412c-a068-3713d4a84721 tempest-VolumeDependencyTests-430671456 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:33:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-362eeef0-01e9-412c-a068-3713d4a84721 tempest-VolumeDependencyTests-430671456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:33:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-362eeef0-01e9-412c-a068-3713d4a84721 tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1d785a6-8a24-4ff5-9352-0cabab2dd09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48bd39b2-235e-4f68-84e5-550b7d72a86f', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-362eeef0-01e9-412c-a068-3713d4a84721 tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c9971f-8be5-41b7-9722-2f5b7dd265e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:33:56 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-362eeef0-01e9-412c-a068-3713d4a84721 tempest-VolumeDependencyTests-430671456 None] Volume volume-48bd39b2-235e-4f68-84e5-550b7d72a86f (48bd39b2-235e-4f68-84e5-550b7d72a86f): created successfully
Apr 02 10:33:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-362eeef0-01e9-412c-a068-3713d4a84721 tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c9971f-8be5-41b7-9722-2f5b7dd265e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:33:56 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-362eeef0-01e9-412c-a068-3713d4a84721 tempest-VolumeDependencyTests-430671456 None] Flow 'volume_create_manager' (498ab7a5-388d-44f3-804f-236c8a2379af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:33:56 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-362eeef0-01e9-412c-a068-3713d4a84721 tempest-VolumeDependencyTests-430671456 None] Created volume successfully.
Apr 02 10:33:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ed505a48-cd17-470a-ab92-2e37bc0d9749 tempest-VolumeDependencyTests-430671456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:33:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ed505a48-cd17-470a-ab92-2e37bc0d9749 tempest-VolumeDependencyTests-430671456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:33:58 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-ed505a48-cd17-470a-ab92-2e37bc0d9749 tempest-VolumeDependencyTests-430671456 None] Creating offline snapshot 0a80660a-dc95-4562-8468-32edd3365aa4 of volume 48bd39b2-235e-4f68-84e5-550b7d72a86f {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:33:58 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2da1986-5085-4b28-a130-2005c4c71bfe]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:33:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ed505a48-cd17-470a-ab92-2e37bc0d9749 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:58 devstack sudo[89571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f
Apr 02 10:33:58 devstack sudo[89571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:58 devstack sudo[89571]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ed505a48-cd17-470a-ab92-2e37bc0d9749 tempest-VolumeDependencyTests-430671456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f" returned: 0 in 0.432s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ed505a48-cd17-470a-ab92-2e37bc0d9749 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f.0a80660a-dc95-4562-8468-32edd3365aa4 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:58 devstack sudo[89576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f.0a80660a-dc95-4562-8468-32edd3365aa4 1G
Apr 02 10:33:58 devstack sudo[89576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:59 devstack sudo[89576]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ed505a48-cd17-470a-ab92-2e37bc0d9749 tempest-VolumeDependencyTests-430671456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f.0a80660a-dc95-4562-8468-32edd3365aa4 1G" returned: 0 in 0.485s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ed505a48-cd17-470a-ab92-2e37bc0d9749 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48bd39b2-235e-4f68-84e5-550b7d72a86f -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f.0a80660a-dc95-4562-8468-32edd3365aa4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:59 devstack sudo[89581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48bd39b2-235e-4f68-84e5-550b7d72a86f -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f.0a80660a-dc95-4562-8468-32edd3365aa4
Apr 02 10:33:59 devstack sudo[89581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:59 devstack sudo[89581]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ed505a48-cd17-470a-ab92-2e37bc0d9749 tempest-VolumeDependencyTests-430671456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48bd39b2-235e-4f68-84e5-550b7d72a86f -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f.0a80660a-dc95-4562-8468-32edd3365aa4" returned: 0 in 0.429s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:59 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-ed505a48-cd17-470a-ab92-2e37bc0d9749 tempest-VolumeDependencyTests-430671456 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f.0a80660a-dc95-4562-8468-32edd3365aa4 is being set with open permissions: ugo+rw
Apr 02 10:33:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ed505a48-cd17-470a-ab92-2e37bc0d9749 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f.0a80660a-dc95-4562-8468-32edd3365aa4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:59 devstack sudo[89586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f.0a80660a-dc95-4562-8468-32edd3365aa4
Apr 02 10:33:59 devstack sudo[89586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:33:59 devstack sudo[89586]: pam_unix(sudo:session): session closed for user root
Apr 02 10:33:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ed505a48-cd17-470a-ab92-2e37bc0d9749 tempest-VolumeDependencyTests-430671456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f.0a80660a-dc95-4562-8468-32edd3365aa4" returned: 0 in 0.431s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:33:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ed505a48-cd17-470a-ab92-2e37bc0d9749 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:33:59 devstack sudo[89589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f.info
Apr 02 10:33:59 devstack sudo[89589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:00 devstack sudo[89589]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ed505a48-cd17-470a-ab92-2e37bc0d9749 tempest-VolumeDependencyTests-430671456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f.info" returned: 0 in 0.416s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:00 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-ed505a48-cd17-470a-ab92-2e37bc0d9749 tempest-VolumeDependencyTests-430671456 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f.info is being set with open permissions: ugo+rw
Apr 02 10:34:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ed505a48-cd17-470a-ab92-2e37bc0d9749 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:00 devstack sudo[89592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f.info
Apr 02 10:34:00 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:00 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ed505a48-cd17-470a-ab92-2e37bc0d9749 tempest-VolumeDependencyTests-430671456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f.info" returned: 0 in 0.420s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ed505a48-cd17-470a-ab92-2e37bc0d9749 tempest-VolumeDependencyTests-430671456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.673s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:00 devstack cinder-volume[82102]: DEBUG dbcounter [-] [82102] Writing DB stats cinder:SELECT=99,cinder:UPDATE=90,cinder:INSERT=31,cinder:DELETE=10 {{(pid=82102) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 02 10:34:00 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-ed505a48-cd17-470a-ab92-2e37bc0d9749 tempest-VolumeDependencyTests-430671456 None] Create snapshot completed successfully
Apr 02 10:34:01 devstack cinder-volume[82102]: DEBUG dbcounter [-] [82102] Writing DB stats cinder:UPDATE=125,cinder:SELECT=97,cinder:DELETE=10,cinder:INSERT=23 {{(pid=82102) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 02 10:34:01 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:34:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Flow 'volume_create_manager' (deb2e966-12a2-4f8e-b611-6ea0c6712fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:34:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea775101-8290-4b80-800b-f379b01dc1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea775101-8290-4b80-800b-f379b01dc1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-168576148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e92768b-318a-472d-bc96-1d636f8bc076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f7585d194e46719326ebb67041f04c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0a80660a-dc95-4562-8468-32edd3365aa4,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:01Z,use_quota=True,user_id='fd25044b54d84f9a884ab18a9aef2635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (616e657f-be04-4910-a5f3-f54d433f923c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (616e657f-be04-4910-a5f3-f54d433f923c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffb917de-b7a0-46b9-a127-da6c3fc7fdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffb917de-b7a0-46b9-a127-da6c3fc7fdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7e92768b-318a-472d-bc96-1d636f8bc076', 'volume_name': 'volume-7e92768b-318a-472d-bc96-1d636f8bc076', 'volume_size': 1, 'snapshot_id': '0a80660a-dc95-4562-8468-32edd3365aa4'}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbca6ca0-89ed-4c43-8809-0520b8a5f1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbca6ca0-89ed-4c43-8809-0520b8a5f1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24fa34f9-4267-4ece-8897-62fcb533aa05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:01 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Volume 7e92768b-318a-472d-bc96-1d636f8bc076: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7e92768b-318a-472d-bc96-1d636f8bc076', 'volume_size': 1, 'snapshot_id': '0a80660a-dc95-4562-8468-32edd3365aa4'}
Apr 02 10:34:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:01 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Acquiring lock "cinder-quobyte-0a80660a-dc95-4562-8468-32edd3365aa4-7e92768b-318a-472d-bc96-1d636f8bc076" by "_create_volume_from_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:01 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Lock "cinder-quobyte-0a80660a-dc95-4562-8468-32edd3365aa4-7e92768b-318a-472d-bc96-1d636f8bc076" acquired by "_create_volume_from_snapshot" :: waited 0.011s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:01 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Creating volume 7e92768b-318a-472d-bc96-1d636f8bc076 from snapshot 0a80660a-dc95-4562-8468-32edd3365aa4 {{(pid=82102) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 02 10:34:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:01 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:34:01 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:34:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:01 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:34:01 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Acquiring lock "cinder-quobyte-7e92768b-318a-472d-bc96-1d636f8bc076" by "_copy_volume_from_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:01 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Lock "cinder-quobyte-7e92768b-318a-472d-bc96-1d636f8bc076" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:01 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] snapshot: 0a80660a-dc95-4562-8468-32edd3365aa4, volume: 7e92768b-318a-472d-bc96-1d636f8bc076,  {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 02 10:34:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:01 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:34:01 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:34:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:01 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18f5891-3929-485d-99da-58fde6fc5aca]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:34:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f.0a80660a-dc95-4562-8468-32edd3365aa4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:01 devstack sudo[89596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f.0a80660a-dc95-4562-8468-32edd3365aa4
Apr 02 10:34:01 devstack sudo[89596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:02 devstack sudo[89596]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f.0a80660a-dc95-4562-8468-32edd3365aa4" returned: 0 in 0.455s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:02 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48bd39b2-235e-4f68-84e5-550b7d72a86f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:34:02 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 02 10:34:02 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Creating direct copy from snapshot {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 02 10:34:02 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4b899f-973f-4099-b1d3-ae37eb1f3830]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:34:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:02 devstack sudo[89601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f
Apr 02 10:34:02 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:02 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f" returned: 0 in 0.486s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:02 devstack cinder-volume[82102]: DEBUG cinder.utils [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Path /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-7e92768b-318a-472d-bc96-1d636f8bc076 not found in is_blk_device check {{(pid=82102) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 02 10:34:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-7e92768b-318a-472d-bc96-1d636f8bc076 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:02 devstack sudo[89606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-7e92768b-318a-472d-bc96-1d636f8bc076
Apr 02 10:34:02 devstack sudo[89606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:04 devstack sudo[89606]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-7e92768b-318a-472d-bc96-1d636f8bc076" returned: 0 in 2.144s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:04 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[185fff7d-14e0-4830-a9a6-07cd9f015920]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:34:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:04 devstack sudo[89621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f
Apr 02 10:34:04 devstack sudo[89621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:05 devstack sudo[89621]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f" returned: 0 in 0.571s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:05 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Image conversion details: src /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f, size 1024.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-7e92768b-318a-472d-bc96-1d636f8bc076 {{(pid=82102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 02 10:34:05 devstack cinder-volume[82102]: INFO cinder.image.image_utils [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Converted 1024.00 MB image at 477.35 MB/s
Apr 02 10:34:05 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-7e92768b-318a-472d-bc96-1d636f8bc076 is being set with open permissions: ugo+rw
Apr 02 10:34:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-7e92768b-318a-472d-bc96-1d636f8bc076 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:05 devstack sudo[89626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-7e92768b-318a-472d-bc96-1d636f8bc076
Apr 02 10:34:05 devstack sudo[89626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:05 devstack sudo[89626]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-7e92768b-318a-472d-bc96-1d636f8bc076" returned: 0 in 0.392s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:05 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Lock "cinder-quobyte-7e92768b-318a-472d-bc96-1d636f8bc076" released by "_copy_volume_from_snapshot" :: held 4.099s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:34:05 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Lock "cinder-quobyte-0a80660a-dc95-4562-8468-32edd3365aa4-7e92768b-318a-472d-bc96-1d636f8bc076" released by "_create_volume_from_snapshot" :: held 4.115s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:34:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.126s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:05 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24fa34f9-4267-4ece-8897-62fcb533aa05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e92768b-318a-472d-bc96-1d636f8bc076', 'volume_size': 1, 'snapshot_id': '0a80660a-dc95-4562-8468-32edd3365aa4'}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:05 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d9210a-a795-449c-9f4b-bb12238a6925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:05 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Volume volume-7e92768b-318a-472d-bc96-1d636f8bc076 (7e92768b-318a-472d-bc96-1d636f8bc076): created successfully
Apr 02 10:34:05 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d9210a-a795-449c-9f4b-bb12238a6925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:05 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Flow 'volume_create_manager' (deb2e966-12a2-4f8e-b611-6ea0c6712fd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:34:05 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-5022bacb-4b1e-4925-9412-f8267e5ae670 tempest-VolumeDependencyTests-430671456 None] Created volume successfully.
Apr 02 10:34:06 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1555f53e-d3c7-4aff-8d97-e1f269a919f6 tempest-VolumeDependencyTests-430671456 None] Acquiring lock "cinder-0a80660a-dc95-4562-8468-32edd3365aa4-delete_snapshot" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:06 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1555f53e-d3c7-4aff-8d97-e1f269a919f6 tempest-VolumeDependencyTests-430671456 None] Lock "cinder-0a80660a-dc95-4562-8468-32edd3365aa4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:06 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1555f53e-d3c7-4aff-8d97-e1f269a919f6 tempest-VolumeDependencyTests-430671456 None] Acquiring lock "cinder-quobyte-48bd39b2-235e-4f68-84e5-550b7d72a86f" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:06 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1555f53e-d3c7-4aff-8d97-e1f269a919f6 tempest-VolumeDependencyTests-430671456 None] Lock "cinder-quobyte-48bd39b2-235e-4f68-84e5-550b7d72a86f" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:06 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1555f53e-d3c7-4aff-8d97-e1f269a919f6 tempest-VolumeDependencyTests-430671456 None] Acquiring lock "cinder-quobyte-0a80660a-dc95-4562-8468-32edd3365aa4" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:06 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1555f53e-d3c7-4aff-8d97-e1f269a919f6 tempest-VolumeDependencyTests-430671456 None] Lock "cinder-quobyte-0a80660a-dc95-4562-8468-32edd3365aa4" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:06 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-1555f53e-d3c7-4aff-8d97-e1f269a919f6 tempest-VolumeDependencyTests-430671456 None] Deleting offline snapshot 0a80660a-dc95-4562-8468-32edd3365aa4 of volume 48bd39b2-235e-4f68-84e5-550b7d72a86f {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:34:06 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-1555f53e-d3c7-4aff-8d97-e1f269a919f6 tempest-VolumeDependencyTests-430671456 None] snapshot_file for this snap is: volume-48bd39b2-235e-4f68-84e5-550b7d72a86f.0a80660a-dc95-4562-8468-32edd3365aa4 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:34:06 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0369beb-6709-4e46-af02-08a865650203]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:34:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1555f53e-d3c7-4aff-8d97-e1f269a919f6 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f.0a80660a-dc95-4562-8468-32edd3365aa4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:06 devstack sudo[89629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f.0a80660a-dc95-4562-8468-32edd3365aa4
Apr 02 10:34:06 devstack sudo[89629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:07 devstack sudo[89629]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1555f53e-d3c7-4aff-8d97-e1f269a919f6 tempest-VolumeDependencyTests-430671456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f.0a80660a-dc95-4562-8468-32edd3365aa4" returned: 0 in 0.442s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:07 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-1555f53e-d3c7-4aff-8d97-e1f269a919f6 tempest-VolumeDependencyTests-430671456 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48bd39b2-235e-4f68-84e5-550b7d72a86f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:34:07 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa380ee-b519-491b-bcad-fe39731af8d7]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:34:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1555f53e-d3c7-4aff-8d97-e1f269a919f6 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:07 devstack sudo[89634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f
Apr 02 10:34:07 devstack sudo[89634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:07 devstack sudo[89634]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1555f53e-d3c7-4aff-8d97-e1f269a919f6 tempest-VolumeDependencyTests-430671456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f" returned: 0 in 0.437s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1555f53e-d3c7-4aff-8d97-e1f269a919f6 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f.0a80660a-dc95-4562-8468-32edd3365aa4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:07 devstack sudo[89639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f.0a80660a-dc95-4562-8468-32edd3365aa4
Apr 02 10:34:07 devstack sudo[89639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:08 devstack sudo[89639]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1555f53e-d3c7-4aff-8d97-e1f269a919f6 tempest-VolumeDependencyTests-430671456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f.0a80660a-dc95-4562-8468-32edd3365aa4" returned: 0 in 0.422s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1555f53e-d3c7-4aff-8d97-e1f269a919f6 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f.0a80660a-dc95-4562-8468-32edd3365aa4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:08 devstack sudo[89644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f.0a80660a-dc95-4562-8468-32edd3365aa4
Apr 02 10:34:08 devstack sudo[89644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:08 devstack sudo[89644]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1555f53e-d3c7-4aff-8d97-e1f269a919f6 tempest-VolumeDependencyTests-430671456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f.0a80660a-dc95-4562-8468-32edd3365aa4" returned: 0 in 0.448s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:08 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1555f53e-d3c7-4aff-8d97-e1f269a919f6 tempest-VolumeDependencyTests-430671456 None] Lock "cinder-quobyte-0a80660a-dc95-4562-8468-32edd3365aa4" released by "_delete_snapshot" :: held 1.802s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:34:08 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1555f53e-d3c7-4aff-8d97-e1f269a919f6 tempest-VolumeDependencyTests-430671456 None] Lock "cinder-quobyte-48bd39b2-235e-4f68-84e5-550b7d72a86f" released by "delete_snapshot" :: held 1.815s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:34:08 devstack cinder-volume[82102]: DEBUG oslo_service.periodic_task [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 02 10:34:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:34:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:34:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:08 devstack sudo[89647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:34:08 devstack sudo[89647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:08 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-1555f53e-d3c7-4aff-8d97-e1f269a919f6 tempest-VolumeDependencyTests-430671456 None] Created reservations ['43914c8e-cd27-4929-9b54-6f0e27e53be8', 'c225d789-a5c8-478b-a73c-ddcd793189b5', '3e39fed5-b35d-4956-b4cd-eb5a9f65eb08', 'b9deb42a-c55c-4b5e-af68-ea225087c36a'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:34:08 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-1555f53e-d3c7-4aff-8d97-e1f269a919f6 tempest-VolumeDependencyTests-430671456 None] Delete snapshot completed successfully.
Apr 02 10:34:08 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1555f53e-d3c7-4aff-8d97-e1f269a919f6 tempest-VolumeDependencyTests-430671456 None] Lock "cinder-0a80660a-dc95-4562-8468-32edd3365aa4-delete_snapshot" released by "delete_snapshot" :: held 1.912s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:34:08 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-67d08486-e949-4620-ab22-ce686abed7c0 tempest-VolumeDependencyTests-430671456 None] Acquiring lock "cinder-48bd39b2-235e-4f68-84e5-550b7d72a86f-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:08 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-67d08486-e949-4620-ab22-ce686abed7c0 tempest-VolumeDependencyTests-430671456 None] Lock "cinder-48bd39b2-235e-4f68-84e5-550b7d72a86f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:08 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-67d08486-e949-4620-ab22-ce686abed7c0 tempest-VolumeDependencyTests-430671456 None] Acquiring lock "cinder-quobyte-48bd39b2-235e-4f68-84e5-550b7d72a86f" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:08 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-67d08486-e949-4620-ab22-ce686abed7c0 tempest-VolumeDependencyTests-430671456 None] Lock "cinder-quobyte-48bd39b2-235e-4f68-84e5-550b7d72a86f" acquired by "delete_volume" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:08 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b81551-36ac-4203-a381-708477f7a950]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:34:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-67d08486-e949-4620-ab22-ce686abed7c0 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:09 devstack sudo[89649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f
Apr 02 10:34:09 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:09 devstack sudo[89647]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.425s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:09 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:34:09 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-67d08486-e949-4620-ab22-ce686abed7c0 tempest-VolumeDependencyTests-430671456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f" returned: 0 in 0.443s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-67d08486-e949-4620-ab22-ce686abed7c0 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:09 devstack sudo[89655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f
Apr 02 10:34:09 devstack sudo[89655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:09 devstack sudo[89655]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-67d08486-e949-4620-ab22-ce686abed7c0 tempest-VolumeDependencyTests-430671456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-48bd39b2-235e-4f68-84e5-550b7d72a86f" returned: 0 in 0.386s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:09 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-67d08486-e949-4620-ab22-ce686abed7c0 tempest-VolumeDependencyTests-430671456 None] Lock "cinder-quobyte-48bd39b2-235e-4f68-84e5-550b7d72a86f" released by "delete_volume" :: held 0.868s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:34:09 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-67d08486-e949-4620-ab22-ce686abed7c0 tempest-VolumeDependencyTests-430671456 None] Created reservations ['1a006388-177e-4079-bc1a-daea41a505b5', 'deec1696-5b58-4fad-8ac3-7ed5bf4627fa', '24fa32c3-b02c-4862-879b-f14c39483a1f', '533f6277-9678-46f9-b8eb-a65ed7f0da04'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:34:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-67d08486-e949-4620-ab22-ce686abed7c0 tempest-VolumeDependencyTests-430671456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-67d08486-e949-4620-ab22-ce686abed7c0 tempest-VolumeDependencyTests-430671456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:09 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-67d08486-e949-4620-ab22-ce686abed7c0 tempest-VolumeDependencyTests-430671456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:34:09 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-67d08486-e949-4620-ab22-ce686abed7c0 tempest-VolumeDependencyTests-430671456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:34:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-67d08486-e949-4620-ab22-ce686abed7c0 tempest-VolumeDependencyTests-430671456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-67d08486-e949-4620-ab22-ce686abed7c0 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:09 devstack sudo[89658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:34:09 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:10 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4e09cb8-a1db-4c33-8187-965b6b4a310b tempest-VolumeDependencyTests-430671456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:34:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f4e09cb8-a1db-4c33-8187-965b6b4a310b tempest-VolumeDependencyTests-430671456 None] Flow 'volume_create_manager' (1923bd77-a761-48ef-97ba-926ceb2ac4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:34:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f4e09cb8-a1db-4c33-8187-965b6b4a310b tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565e2c32-d27c-49c6-a2d0-0518c66aed68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:10 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f4e09cb8-a1db-4c33-8187-965b6b4a310b tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565e2c32-d27c-49c6-a2d0-0518c66aed68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2044981374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f65bb08c-9e24-4bae-8867-311ea9cd3ac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f7585d194e46719326ebb67041f04c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:10Z,use_quota=True,user_id='fd25044b54d84f9a884ab18a9aef2635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f4e09cb8-a1db-4c33-8187-965b6b4a310b tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d3cd6a-1c72-4160-893d-3ded8cf2ba85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f4e09cb8-a1db-4c33-8187-965b6b4a310b tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d3cd6a-1c72-4160-893d-3ded8cf2ba85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f4e09cb8-a1db-4c33-8187-965b6b4a310b tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca15679-eb05-4745-83ee-62c6a1a51437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f4e09cb8-a1db-4c33-8187-965b6b4a310b tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca15679-eb05-4745-83ee-62c6a1a51437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f65bb08c-9e24-4bae-8867-311ea9cd3ac9', 'volume_name': 'volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f4e09cb8-a1db-4c33-8187-965b6b4a310b tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d7402c-218a-4111-a6b7-d3419e5e240e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f4e09cb8-a1db-4c33-8187-965b6b4a310b tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d7402c-218a-4111-a6b7-d3419e5e240e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f4e09cb8-a1db-4c33-8187-965b6b4a310b tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e5f0a75-f3ba-4b72-96c7-b6b185a5f9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:10 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-f4e09cb8-a1db-4c33-8187-965b6b4a310b tempest-VolumeDependencyTests-430671456 None] Volume f65bb08c-9e24-4bae-8867-311ea9cd3ac9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9', 'volume_size': 1}
Apr 02 10:34:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f4e09cb8-a1db-4c33-8187-965b6b4a310b tempest-VolumeDependencyTests-430671456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f4e09cb8-a1db-4c33-8187-965b6b4a310b tempest-VolumeDependencyTests-430671456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:10 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f4e09cb8-a1db-4c33-8187-965b6b4a310b tempest-VolumeDependencyTests-430671456 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2044981374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f65bb08c-9e24-4bae-8867-311ea9cd3ac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f7585d194e46719326ebb67041f04c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:10Z,use_quota=True,user_id='fd25044b54d84f9a884ab18a9aef2635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:34:10 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-f4e09cb8-a1db-4c33-8187-965b6b4a310b tempest-VolumeDependencyTests-430671456 None] Creating volume f65bb08c-9e24-4bae-8867-311ea9cd3ac9 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:34:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f4e09cb8-a1db-4c33-8187-965b6b4a310b tempest-VolumeDependencyTests-430671456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f4e09cb8-a1db-4c33-8187-965b6b4a310b tempest-VolumeDependencyTests-430671456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:10 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f4e09cb8-a1db-4c33-8187-965b6b4a310b tempest-VolumeDependencyTests-430671456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:34:10 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f4e09cb8-a1db-4c33-8187-965b6b4a310b tempest-VolumeDependencyTests-430671456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:34:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f4e09cb8-a1db-4c33-8187-965b6b4a310b tempest-VolumeDependencyTests-430671456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:10 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f4e09cb8-a1db-4c33-8187-965b6b4a310b tempest-VolumeDependencyTests-430671456 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:34:10 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-f4e09cb8-a1db-4c33-8187-965b6b4a310b tempest-VolumeDependencyTests-430671456 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:34:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f4e09cb8-a1db-4c33-8187-965b6b4a310b tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-67d08486-e949-4620-ab22-ce686abed7c0 tempest-VolumeDependencyTests-430671456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.487s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:10 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-67d08486-e949-4620-ab22-ce686abed7c0 tempest-VolumeDependencyTests-430671456 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:34:10 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-67d08486-e949-4620-ab22-ce686abed7c0 tempest-VolumeDependencyTests-430671456 None] Deleted volume successfully.
Apr 02 10:34:10 devstack sudo[89661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9 1073741824
Apr 02 10:34:10 devstack sudo[89661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:10 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-67d08486-e949-4620-ab22-ce686abed7c0 tempest-VolumeDependencyTests-430671456 None] Lock "cinder-48bd39b2-235e-4f68-84e5-550b7d72a86f-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:34:10 devstack sudo[89661]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f4e09cb8-a1db-4c33-8187-965b6b4a310b tempest-VolumeDependencyTests-430671456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9 1073741824" returned: 0 in 0.491s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f4e09cb8-a1db-4c33-8187-965b6b4a310b tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:11 devstack sudo[89667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9
Apr 02 10:34:11 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:11 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f4e09cb8-a1db-4c33-8187-965b6b4a310b tempest-VolumeDependencyTests-430671456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9" returned: 0 in 0.421s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:11 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f4e09cb8-a1db-4c33-8187-965b6b4a310b tempest-VolumeDependencyTests-430671456 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:34:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f4e09cb8-a1db-4c33-8187-965b6b4a310b tempest-VolumeDependencyTests-430671456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:11 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f4e09cb8-a1db-4c33-8187-965b6b4a310b tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e5f0a75-f3ba-4b72-96c7-b6b185a5f9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:11 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f4e09cb8-a1db-4c33-8187-965b6b4a310b tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e94dc896-8262-4e90-b92e-a25370750042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:11 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-f4e09cb8-a1db-4c33-8187-965b6b4a310b tempest-VolumeDependencyTests-430671456 None] Volume volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9 (f65bb08c-9e24-4bae-8867-311ea9cd3ac9): created successfully
Apr 02 10:34:11 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f4e09cb8-a1db-4c33-8187-965b6b4a310b tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e94dc896-8262-4e90-b92e-a25370750042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:11 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f4e09cb8-a1db-4c33-8187-965b6b4a310b tempest-VolumeDependencyTests-430671456 None] Flow 'volume_create_manager' (1923bd77-a761-48ef-97ba-926ceb2ac4d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:34:11 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-f4e09cb8-a1db-4c33-8187-965b6b4a310b tempest-VolumeDependencyTests-430671456 None] Created volume successfully.
Apr 02 10:34:12 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:34:12 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Flow 'volume_create_manager' (637997cd-6fa4-48ae-8f2f-5ed7deaaa5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:34:12 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c73c5b2-559c-45fe-96f2-73028472e486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:12 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c73c5b2-559c-45fe-96f2-73028472e486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-205254826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bbc302f-3b98-4c19-8c32-a8aaf4891395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f7585d194e46719326ebb67041f04c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=f65bb08c-9e24-4bae-8867-311ea9cd3ac9,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:13Z,use_quota=True,user_id='fd25044b54d84f9a884ab18a9aef2635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:12 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a22ad91-49f9-49f7-b574-23c80fec52f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:12 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a22ad91-49f9-49f7-b574-23c80fec52f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:12 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5966203b-49f7-4722-bd5b-be1e2e7252c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:12 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5966203b-49f7-4722-bd5b-be1e2e7252c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9bbc302f-3b98-4c19-8c32-a8aaf4891395', 'volume_name': 'volume-9bbc302f-3b98-4c19-8c32-a8aaf4891395', 'volume_size': 1, 'source_volid': 'f65bb08c-9e24-4bae-8867-311ea9cd3ac9', 'source_volstatus': 'available'}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:12 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (059fa9ec-d218-4d5b-887e-6e97cf7da9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:12 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (059fa9ec-d218-4d5b-887e-6e97cf7da9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:12 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf741e09-60ef-4d7a-8d55-ddf21a9a6520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:12 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Volume 9bbc302f-3b98-4c19-8c32-a8aaf4891395: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9bbc302f-3b98-4c19-8c32-a8aaf4891395', 'volume_size': 1, 'source_volid': 'f65bb08c-9e24-4bae-8867-311ea9cd3ac9', 'source_volstatus': 'available'}
Apr 02 10:34:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:12 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Cloning volume f65bb08c-9e24-4bae-8867-311ea9cd3ac9 to volume 9bbc302f-3b98-4c19-8c32-a8aaf4891395
Apr 02 10:34:12 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Creating offline snapshot 04acbc37-bfc9-4c2d-a982-27b86db8ceff of volume f65bb08c-9e24-4bae-8867-311ea9cd3ac9 {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:34:12 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7446c35c-0935-4eee-b763-898dcf238320]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:34:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:12 devstack sudo[89671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9
Apr 02 10:34:12 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:13 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9" returned: 0 in 0.519s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9.04acbc37-bfc9-4c2d-a982-27b86db8ceff 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:13 devstack sudo[89676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9.04acbc37-bfc9-4c2d-a982-27b86db8ceff 1G
Apr 02 10:34:13 devstack sudo[89676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:13 devstack sudo[89676]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9.04acbc37-bfc9-4c2d-a982-27b86db8ceff 1G" returned: 0 in 0.475s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9.04acbc37-bfc9-4c2d-a982-27b86db8ceff {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:13 devstack sudo[89681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9.04acbc37-bfc9-4c2d-a982-27b86db8ceff
Apr 02 10:34:13 devstack sudo[89681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:14 devstack sudo[89681]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9.04acbc37-bfc9-4c2d-a982-27b86db8ceff" returned: 0 in 0.415s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:14 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9.04acbc37-bfc9-4c2d-a982-27b86db8ceff is being set with open permissions: ugo+rw
Apr 02 10:34:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9.04acbc37-bfc9-4c2d-a982-27b86db8ceff {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:14 devstack sudo[89686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9.04acbc37-bfc9-4c2d-a982-27b86db8ceff
Apr 02 10:34:14 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:14 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9.04acbc37-bfc9-4c2d-a982-27b86db8ceff" returned: 0 in 0.392s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:14 devstack sudo[89689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9.info
Apr 02 10:34:14 devstack sudo[89689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:15 devstack sudo[89689]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9.info" returned: 0 in 0.423s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:15 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9.info is being set with open permissions: ugo+rw
Apr 02 10:34:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:15 devstack sudo[89692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9.info
Apr 02 10:34:15 devstack sudo[89692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:15 devstack sudo[89692]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9.info" returned: 0 in 0.412s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:15 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Acquiring lock "cinder-quobyte-9bbc302f-3b98-4c19-8c32-a8aaf4891395" by "_copy_volume_from_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:15 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Lock "cinder-quobyte-9bbc302f-3b98-4c19-8c32-a8aaf4891395" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] snapshot: 04acbc37-bfc9-4c2d-a982-27b86db8ceff, volume: 9bbc302f-3b98-4c19-8c32-a8aaf4891395,  {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 02 10:34:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:34:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:34:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:15 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc76f51c-b8b2-4be0-8607-92e1a935c08c]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:34:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9.04acbc37-bfc9-4c2d-a982-27b86db8ceff {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:15 devstack sudo[89695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9.04acbc37-bfc9-4c2d-a982-27b86db8ceff
Apr 02 10:34:15 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:15 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9.04acbc37-bfc9-4c2d-a982-27b86db8ceff" returned: 0 in 0.464s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:34:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9 {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 02 10:34:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Creating direct copy from snapshot {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 02 10:34:15 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[809e0faa-5d72-407c-868b-8f67f8c925d9]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:34:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:16 devstack sudo[89700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9
Apr 02 10:34:16 devstack sudo[89700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:16 devstack sudo[89700]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9" returned: 0 in 0.468s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:16 devstack cinder-volume[82102]: DEBUG cinder.utils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Path /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9bbc302f-3b98-4c19-8c32-a8aaf4891395 not found in is_blk_device check {{(pid=82102) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 02 10:34:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9bbc302f-3b98-4c19-8c32-a8aaf4891395 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:16 devstack sudo[89705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9bbc302f-3b98-4c19-8c32-a8aaf4891395
Apr 02 10:34:16 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:18 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9bbc302f-3b98-4c19-8c32-a8aaf4891395" returned: 0 in 1.841s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:18 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a203291f-4492-4bf8-be05-2fdc733db61b]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:34:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:18 devstack sudo[89717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9
Apr 02 10:34:18 devstack sudo[89717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:18 devstack sudo[89717]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9" returned: 0 in 0.582s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:18 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Image conversion details: src /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9, size 1024.00 MB, duration 1.84 sec, destination /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9bbc302f-3b98-4c19-8c32-a8aaf4891395 {{(pid=82102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 02 10:34:18 devstack cinder-volume[82102]: INFO cinder.image.image_utils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Converted 1024.00 MB image at 555.65 MB/s
Apr 02 10:34:18 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9bbc302f-3b98-4c19-8c32-a8aaf4891395 is being set with open permissions: ugo+rw
Apr 02 10:34:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9bbc302f-3b98-4c19-8c32-a8aaf4891395 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:18 devstack sudo[89722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9bbc302f-3b98-4c19-8c32-a8aaf4891395
Apr 02 10:34:18 devstack sudo[89722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:19 devstack sudo[89722]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9bbc302f-3b98-4c19-8c32-a8aaf4891395" returned: 0 in 0.399s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:19 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Lock "cinder-quobyte-9bbc302f-3b98-4c19-8c32-a8aaf4891395" released by "_copy_volume_from_snapshot" :: held 3.798s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:34:19 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Acquiring lock "cinder-quobyte-04acbc37-bfc9-4c2d-a982-27b86db8ceff" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:19 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Lock "cinder-quobyte-04acbc37-bfc9-4c2d-a982-27b86db8ceff" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:19 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Deleting offline snapshot 04acbc37-bfc9-4c2d-a982-27b86db8ceff of volume f65bb08c-9e24-4bae-8867-311ea9cd3ac9 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:34:19 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] snapshot_file for this snap is: volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9.04acbc37-bfc9-4c2d-a982-27b86db8ceff {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:34:19 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba809cd-5cdd-4859-852d-5932e2d0a132]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:34:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9.04acbc37-bfc9-4c2d-a982-27b86db8ceff {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:19 devstack sudo[89725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9.04acbc37-bfc9-4c2d-a982-27b86db8ceff
Apr 02 10:34:19 devstack sudo[89725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:19 devstack sudo[89725]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9.04acbc37-bfc9-4c2d-a982-27b86db8ceff" returned: 0 in 0.469s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:19 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:34:19 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef6bceb-4ad8-4424-b960-83b49884773b]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:34:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:19 devstack sudo[89730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9
Apr 02 10:34:19 devstack sudo[89730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:20 devstack sudo[89730]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9" returned: 0 in 0.464s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9.04acbc37-bfc9-4c2d-a982-27b86db8ceff {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:20 devstack sudo[89735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9.04acbc37-bfc9-4c2d-a982-27b86db8ceff
Apr 02 10:34:20 devstack sudo[89735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:20 devstack sudo[89735]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9.04acbc37-bfc9-4c2d-a982-27b86db8ceff" returned: 0 in 0.440s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9.04acbc37-bfc9-4c2d-a982-27b86db8ceff {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:20 devstack sudo[89740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9.04acbc37-bfc9-4c2d-a982-27b86db8ceff
Apr 02 10:34:20 devstack sudo[89740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:21 devstack sudo[89740]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9.04acbc37-bfc9-4c2d-a982-27b86db8ceff" returned: 0 in 0.427s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:21 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Lock "cinder-quobyte-04acbc37-bfc9-4c2d-a982-27b86db8ceff" released by "_delete_snapshot" :: held 1.848s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:34:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.407s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:21 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf741e09-60ef-4d7a-8d55-ddf21a9a6520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bbc302f-3b98-4c19-8c32-a8aaf4891395', 'volume_size': 1, 'source_volid': 'f65bb08c-9e24-4bae-8867-311ea9cd3ac9', 'source_volstatus': 'available'}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:21 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b1183c4-1874-476c-878e-93d1ecf283c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:21 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Volume volume-9bbc302f-3b98-4c19-8c32-a8aaf4891395 (9bbc302f-3b98-4c19-8c32-a8aaf4891395): created successfully
Apr 02 10:34:21 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b1183c4-1874-476c-878e-93d1ecf283c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:21 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Flow 'volume_create_manager' (637997cd-6fa4-48ae-8f2f-5ed7deaaa5cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:34:21 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-3f8fe9a5-b1a1-495f-842f-6d313fb67383 tempest-VolumeDependencyTests-430671456 None] Created volume successfully.
Apr 02 10:34:22 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1c06bca6-aa5b-4114-aa2f-aa055188fa06 tempest-VolumeDependencyTests-430671456 None] Acquiring lock "cinder-f65bb08c-9e24-4bae-8867-311ea9cd3ac9-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:22 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1c06bca6-aa5b-4114-aa2f-aa055188fa06 tempest-VolumeDependencyTests-430671456 None] Lock "cinder-f65bb08c-9e24-4bae-8867-311ea9cd3ac9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:22 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1c06bca6-aa5b-4114-aa2f-aa055188fa06 tempest-VolumeDependencyTests-430671456 None] Acquiring lock "cinder-quobyte-f65bb08c-9e24-4bae-8867-311ea9cd3ac9" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:22 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1c06bca6-aa5b-4114-aa2f-aa055188fa06 tempest-VolumeDependencyTests-430671456 None] Lock "cinder-quobyte-f65bb08c-9e24-4bae-8867-311ea9cd3ac9" acquired by "delete_volume" :: waited 0.013s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:22 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91c5024-140a-4dfa-8347-be43008b30e3]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:34:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1c06bca6-aa5b-4114-aa2f-aa055188fa06 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:22 devstack sudo[89744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9
Apr 02 10:34:22 devstack sudo[89744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:22 devstack sudo[89744]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1c06bca6-aa5b-4114-aa2f-aa055188fa06 tempest-VolumeDependencyTests-430671456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9" returned: 0 in 0.499s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1c06bca6-aa5b-4114-aa2f-aa055188fa06 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:22 devstack sudo[89749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9
Apr 02 10:34:22 devstack sudo[89749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:23 devstack sudo[89749]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1c06bca6-aa5b-4114-aa2f-aa055188fa06 tempest-VolumeDependencyTests-430671456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f65bb08c-9e24-4bae-8867-311ea9cd3ac9" returned: 0 in 0.414s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:23 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1c06bca6-aa5b-4114-aa2f-aa055188fa06 tempest-VolumeDependencyTests-430671456 None] Lock "cinder-quobyte-f65bb08c-9e24-4bae-8867-311ea9cd3ac9" released by "delete_volume" :: held 0.948s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:34:23 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-1c06bca6-aa5b-4114-aa2f-aa055188fa06 tempest-VolumeDependencyTests-430671456 None] Created reservations ['3b2c46fc-7e7b-4c3c-9d0c-dda6ed69a38e', '5ceeccd1-3457-4b79-b720-12397f3044e9', 'e50ef6a9-52a0-408c-aed5-62d96851837e', '462c0ec3-ceeb-4a71-8277-42dba63fc0f5'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:34:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-1c06bca6-aa5b-4114-aa2f-aa055188fa06 tempest-VolumeDependencyTests-430671456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-1c06bca6-aa5b-4114-aa2f-aa055188fa06 tempest-VolumeDependencyTests-430671456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:23 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-1c06bca6-aa5b-4114-aa2f-aa055188fa06 tempest-VolumeDependencyTests-430671456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:34:23 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-1c06bca6-aa5b-4114-aa2f-aa055188fa06 tempest-VolumeDependencyTests-430671456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:34:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-1c06bca6-aa5b-4114-aa2f-aa055188fa06 tempest-VolumeDependencyTests-430671456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1c06bca6-aa5b-4114-aa2f-aa055188fa06 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:23 devstack sudo[89753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:34:23 devstack sudo[89753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:23 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-15a36ac7-c507-4e97-97fc-7c87b5acac96 tempest-VolumeDependencyTests-430671456 None] Acquiring lock "cinder-9bbc302f-3b98-4c19-8c32-a8aaf4891395-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:23 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-15a36ac7-c507-4e97-97fc-7c87b5acac96 tempest-VolumeDependencyTests-430671456 None] Lock "cinder-9bbc302f-3b98-4c19-8c32-a8aaf4891395-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:23 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-15a36ac7-c507-4e97-97fc-7c87b5acac96 tempest-VolumeDependencyTests-430671456 None] Acquiring lock "cinder-quobyte-9bbc302f-3b98-4c19-8c32-a8aaf4891395" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:23 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-15a36ac7-c507-4e97-97fc-7c87b5acac96 tempest-VolumeDependencyTests-430671456 None] Lock "cinder-quobyte-9bbc302f-3b98-4c19-8c32-a8aaf4891395" acquired by "delete_volume" :: waited 0.007s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:23 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6135288b-0ef9-43da-9498-f8381bab8002]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:34:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-15a36ac7-c507-4e97-97fc-7c87b5acac96 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9bbc302f-3b98-4c19-8c32-a8aaf4891395 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:23 devstack sudo[89755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9bbc302f-3b98-4c19-8c32-a8aaf4891395
Apr 02 10:34:23 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:23 devstack sudo[89753]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1c06bca6-aa5b-4114-aa2f-aa055188fa06 tempest-VolumeDependencyTests-430671456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.422s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:23 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-1c06bca6-aa5b-4114-aa2f-aa055188fa06 tempest-VolumeDependencyTests-430671456 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:34:23 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-1c06bca6-aa5b-4114-aa2f-aa055188fa06 tempest-VolumeDependencyTests-430671456 None] Deleted volume successfully.
Apr 02 10:34:23 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1c06bca6-aa5b-4114-aa2f-aa055188fa06 tempest-VolumeDependencyTests-430671456 None] Lock "cinder-f65bb08c-9e24-4bae-8867-311ea9cd3ac9-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:34:23 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-15a36ac7-c507-4e97-97fc-7c87b5acac96 tempest-VolumeDependencyTests-430671456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9bbc302f-3b98-4c19-8c32-a8aaf4891395" returned: 0 in 0.489s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-15a36ac7-c507-4e97-97fc-7c87b5acac96 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9bbc302f-3b98-4c19-8c32-a8aaf4891395 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:24 devstack sudo[89761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9bbc302f-3b98-4c19-8c32-a8aaf4891395
Apr 02 10:34:24 devstack sudo[89761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:24 devstack sudo[89761]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-15a36ac7-c507-4e97-97fc-7c87b5acac96 tempest-VolumeDependencyTests-430671456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-9bbc302f-3b98-4c19-8c32-a8aaf4891395" returned: 0 in 0.380s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:24 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-15a36ac7-c507-4e97-97fc-7c87b5acac96 tempest-VolumeDependencyTests-430671456 None] Lock "cinder-quobyte-9bbc302f-3b98-4c19-8c32-a8aaf4891395" released by "delete_volume" :: held 0.895s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:34:24 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-15a36ac7-c507-4e97-97fc-7c87b5acac96 tempest-VolumeDependencyTests-430671456 None] Created reservations ['e93ef603-db23-48d7-9cb2-7fb111ec7943', '0351f474-08da-4c59-b417-4414fc36bd09', '2aab104f-8860-47ef-b9b0-d74315a4adc2', 'c32f19bc-74c8-4f29-a3fe-01fc1d3a791d'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:34:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-15a36ac7-c507-4e97-97fc-7c87b5acac96 tempest-VolumeDependencyTests-430671456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-15a36ac7-c507-4e97-97fc-7c87b5acac96 tempest-VolumeDependencyTests-430671456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:24 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-15a36ac7-c507-4e97-97fc-7c87b5acac96 tempest-VolumeDependencyTests-430671456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:34:24 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-15a36ac7-c507-4e97-97fc-7c87b5acac96 tempest-VolumeDependencyTests-430671456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:34:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-15a36ac7-c507-4e97-97fc-7c87b5acac96 tempest-VolumeDependencyTests-430671456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-15a36ac7-c507-4e97-97fc-7c87b5acac96 tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:24 devstack sudo[89764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:34:24 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:24 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-54b8ea96-bd93-459f-9afa-e54f7a82efeb tempest-VolumeDependencyTests-430671456 None] Acquiring lock "cinder-7e92768b-318a-472d-bc96-1d636f8bc076-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:24 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-54b8ea96-bd93-459f-9afa-e54f7a82efeb tempest-VolumeDependencyTests-430671456 None] Lock "cinder-7e92768b-318a-472d-bc96-1d636f8bc076-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:24 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-54b8ea96-bd93-459f-9afa-e54f7a82efeb tempest-VolumeDependencyTests-430671456 None] Acquiring lock "cinder-quobyte-7e92768b-318a-472d-bc96-1d636f8bc076" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:24 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-54b8ea96-bd93-459f-9afa-e54f7a82efeb tempest-VolumeDependencyTests-430671456 None] Lock "cinder-quobyte-7e92768b-318a-472d-bc96-1d636f8bc076" acquired by "delete_volume" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:24 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3630bb3e-8f47-4254-9f0b-0eb28337d182]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:34:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-54b8ea96-bd93-459f-9afa-e54f7a82efeb tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-7e92768b-318a-472d-bc96-1d636f8bc076 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:24 devstack sudo[89766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-7e92768b-318a-472d-bc96-1d636f8bc076
Apr 02 10:34:24 devstack sudo[89766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:24 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-15a36ac7-c507-4e97-97fc-7c87b5acac96 tempest-VolumeDependencyTests-430671456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.385s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:24 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-15a36ac7-c507-4e97-97fc-7c87b5acac96 tempest-VolumeDependencyTests-430671456 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:34:24 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-15a36ac7-c507-4e97-97fc-7c87b5acac96 tempest-VolumeDependencyTests-430671456 None] Deleted volume successfully.
Apr 02 10:34:24 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-15a36ac7-c507-4e97-97fc-7c87b5acac96 tempest-VolumeDependencyTests-430671456 None] Lock "cinder-9bbc302f-3b98-4c19-8c32-a8aaf4891395-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:34:25 devstack sudo[89766]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-54b8ea96-bd93-459f-9afa-e54f7a82efeb tempest-VolumeDependencyTests-430671456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-7e92768b-318a-472d-bc96-1d636f8bc076" returned: 0 in 0.449s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-54b8ea96-bd93-459f-9afa-e54f7a82efeb tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-7e92768b-318a-472d-bc96-1d636f8bc076 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:25 devstack sudo[89772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-7e92768b-318a-472d-bc96-1d636f8bc076
Apr 02 10:34:25 devstack sudo[89772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:25 devstack sudo[89772]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-54b8ea96-bd93-459f-9afa-e54f7a82efeb tempest-VolumeDependencyTests-430671456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-7e92768b-318a-472d-bc96-1d636f8bc076" returned: 0 in 0.380s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:25 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-54b8ea96-bd93-459f-9afa-e54f7a82efeb tempest-VolumeDependencyTests-430671456 None] Lock "cinder-quobyte-7e92768b-318a-472d-bc96-1d636f8bc076" released by "delete_volume" :: held 0.849s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:34:25 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-54b8ea96-bd93-459f-9afa-e54f7a82efeb tempest-VolumeDependencyTests-430671456 None] Created reservations ['2e347564-ac4b-4e08-8610-0ccd679f4766', 'dac74d17-679a-4ed5-975c-89bf57089a01', '362b83ae-aa79-42c6-8d9a-6ca4d56c18a7', 'f8c7b335-a119-4e27-8703-a0b3dce20799'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:34:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-54b8ea96-bd93-459f-9afa-e54f7a82efeb tempest-VolumeDependencyTests-430671456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-54b8ea96-bd93-459f-9afa-e54f7a82efeb tempest-VolumeDependencyTests-430671456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:25 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-54b8ea96-bd93-459f-9afa-e54f7a82efeb tempest-VolumeDependencyTests-430671456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:34:25 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-54b8ea96-bd93-459f-9afa-e54f7a82efeb tempest-VolumeDependencyTests-430671456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:34:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-54b8ea96-bd93-459f-9afa-e54f7a82efeb tempest-VolumeDependencyTests-430671456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-54b8ea96-bd93-459f-9afa-e54f7a82efeb tempest-VolumeDependencyTests-430671456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:25 devstack sudo[89775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:34:25 devstack sudo[89775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:26 devstack sudo[89775]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-54b8ea96-bd93-459f-9afa-e54f7a82efeb tempest-VolumeDependencyTests-430671456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.458s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:26 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-54b8ea96-bd93-459f-9afa-e54f7a82efeb tempest-VolumeDependencyTests-430671456 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:34:26 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-54b8ea96-bd93-459f-9afa-e54f7a82efeb tempest-VolumeDependencyTests-430671456 None] Deleted volume successfully.
Apr 02 10:34:26 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-54b8ea96-bd93-459f-9afa-e54f7a82efeb tempest-VolumeDependencyTests-430671456 None] Lock "cinder-7e92768b-318a-472d-bc96-1d636f8bc076-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-edd1ab8e-b060-4440-8580-45ae7d427040 tempest-CreateVolumesFromSnapshotTest-389980398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-edd1ab8e-b060-4440-8580-45ae7d427040 tempest-CreateVolumesFromSnapshotTest-389980398 None] Flow 'volume_create_manager' (c7296cca-127b-46f4-80d1-78f3852cec2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-edd1ab8e-b060-4440-8580-45ae7d427040 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb7ccdaf-1ae4-4516-8ddc-cc33bb89c180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-edd1ab8e-b060-4440-8580-45ae7d427040 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb7ccdaf-1ae4-4516-8ddc-cc33bb89c180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1733502976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eca8bd5-c14a-46bd-8629-0b649acd773f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3ec0d897f864fd48c73c167d0e04a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:33Z,use_quota=True,user_id='3704a8c936c648b8acf521c70085dff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-edd1ab8e-b060-4440-8580-45ae7d427040 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (797d05f1-0e62-459a-b4f2-94242c5a20c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-edd1ab8e-b060-4440-8580-45ae7d427040 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (797d05f1-0e62-459a-b4f2-94242c5a20c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-edd1ab8e-b060-4440-8580-45ae7d427040 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec868374-d233-4fd9-94c0-759f9e6bf6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-edd1ab8e-b060-4440-8580-45ae7d427040 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec868374-d233-4fd9-94c0-759f9e6bf6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8eca8bd5-c14a-46bd-8629-0b649acd773f', 'volume_name': 'volume-8eca8bd5-c14a-46bd-8629-0b649acd773f', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-edd1ab8e-b060-4440-8580-45ae7d427040 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbd4dde3-2b1d-49af-bde4-ca6f2c6000d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-edd1ab8e-b060-4440-8580-45ae7d427040 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbd4dde3-2b1d-49af-bde4-ca6f2c6000d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-edd1ab8e-b060-4440-8580-45ae7d427040 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f9137ff-014f-4cc7-870c-611774de1b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:33 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-edd1ab8e-b060-4440-8580-45ae7d427040 tempest-CreateVolumesFromSnapshotTest-389980398 None] Volume 8eca8bd5-c14a-46bd-8629-0b649acd773f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8eca8bd5-c14a-46bd-8629-0b649acd773f', 'volume_size': 1}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-edd1ab8e-b060-4440-8580-45ae7d427040 tempest-CreateVolumesFromSnapshotTest-389980398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-edd1ab8e-b060-4440-8580-45ae7d427040 tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-edd1ab8e-b060-4440-8580-45ae7d427040 tempest-CreateVolumesFromSnapshotTest-389980398 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1733502976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eca8bd5-c14a-46bd-8629-0b649acd773f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3ec0d897f864fd48c73c167d0e04a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:33Z,use_quota=True,user_id='3704a8c936c648b8acf521c70085dff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-edd1ab8e-b060-4440-8580-45ae7d427040 tempest-CreateVolumesFromSnapshotTest-389980398 None] Creating volume 8eca8bd5-c14a-46bd-8629-0b649acd773f {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-edd1ab8e-b060-4440-8580-45ae7d427040 tempest-CreateVolumesFromSnapshotTest-389980398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-edd1ab8e-b060-4440-8580-45ae7d427040 tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-edd1ab8e-b060-4440-8580-45ae7d427040 tempest-CreateVolumesFromSnapshotTest-389980398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-edd1ab8e-b060-4440-8580-45ae7d427040 tempest-CreateVolumesFromSnapshotTest-389980398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-edd1ab8e-b060-4440-8580-45ae7d427040 tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-edd1ab8e-b060-4440-8580-45ae7d427040 tempest-CreateVolumesFromSnapshotTest-389980398 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:34:33 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-edd1ab8e-b060-4440-8580-45ae7d427040 tempest-CreateVolumesFromSnapshotTest-389980398 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-edd1ab8e-b060-4440-8580-45ae7d427040 tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:33 devstack sudo[89821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f 1073741824
Apr 02 10:34:33 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-255c8fcc-8d3a-432e-a0d2-375a9ad64940 tempest-VolumeDependencyTests-1466340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-255c8fcc-8d3a-432e-a0d2-375a9ad64940 tempest-VolumeDependencyTests-1466340 None] Flow 'volume_create_manager' (58cbd530-3322-4f62-89df-c8cbc5298fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-255c8fcc-8d3a-432e-a0d2-375a9ad64940 tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ef0de3-9be3-4933-b4ea-ab56c3f4ea5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-255c8fcc-8d3a-432e-a0d2-375a9ad64940 tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ef0de3-9be3-4933-b4ea-ab56c3f4ea5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-50496807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=969474f1-5ffe-4167-8ae9-a9354bcca1d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e1353b5f6e343c0896535424f8300ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:33Z,use_quota=True,user_id='afea7cd197ef4f3c9f4a091988c19f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-255c8fcc-8d3a-432e-a0d2-375a9ad64940 tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90940ed4-c4f1-4691-9fe5-75e83eb03d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-255c8fcc-8d3a-432e-a0d2-375a9ad64940 tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90940ed4-c4f1-4691-9fe5-75e83eb03d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-255c8fcc-8d3a-432e-a0d2-375a9ad64940 tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41240049-df58-46d7-8c2f-257127c93404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-255c8fcc-8d3a-432e-a0d2-375a9ad64940 tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41240049-df58-46d7-8c2f-257127c93404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '969474f1-5ffe-4167-8ae9-a9354bcca1d4', 'volume_name': 'volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-255c8fcc-8d3a-432e-a0d2-375a9ad64940 tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (269b5076-4531-4ad2-85b3-6268fd5ff39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-255c8fcc-8d3a-432e-a0d2-375a9ad64940 tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (269b5076-4531-4ad2-85b3-6268fd5ff39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-255c8fcc-8d3a-432e-a0d2-375a9ad64940 tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c39c5278-c98e-40a4-9f17-6074dd72c05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:33 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-255c8fcc-8d3a-432e-a0d2-375a9ad64940 tempest-VolumeDependencyTests-1466340 None] Volume 969474f1-5ffe-4167-8ae9-a9354bcca1d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4', 'volume_size': 1}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-255c8fcc-8d3a-432e-a0d2-375a9ad64940 tempest-VolumeDependencyTests-1466340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9b9e390-e643-40f7-b3e4-cad62085cbd4 tempest-CreateVolumesFromImageTest-611315179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d9b9e390-e643-40f7-b3e4-cad62085cbd4 tempest-CreateVolumesFromImageTest-611315179 None] Flow 'volume_create_manager' (a0c7d441-447d-4add-98ea-b065a2fecf20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d9b9e390-e643-40f7-b3e4-cad62085cbd4 tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91cfbb80-1a73-4a8d-b674-b611a08988e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d9b9e390-e643-40f7-b3e4-cad62085cbd4 tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91cfbb80-1a73-4a8d-b674-b611a08988e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-456723341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c8e43f1-4362-43c8-9de9-2995edcf9bb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae43fdb783d4e418675b7fb6883a13c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:33Z,use_quota=True,user_id='63ec4c8d2c794130b79968506dfafc42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d9b9e390-e643-40f7-b3e4-cad62085cbd4 tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c841538c-c2a0-48f7-95af-3eb54f6fbafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d9b9e390-e643-40f7-b3e4-cad62085cbd4 tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c841538c-c2a0-48f7-95af-3eb54f6fbafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d9b9e390-e643-40f7-b3e4-cad62085cbd4 tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (939c2f95-02e4-4e62-b643-e17c45626eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d9b9e390-e643-40f7-b3e4-cad62085cbd4 tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (939c2f95-02e4-4e62-b643-e17c45626eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c8e43f1-4362-43c8-9de9-2995edcf9bb1', 'volume_name': 'volume-0c8e43f1-4362-43c8-9de9-2995edcf9bb1', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d9b9e390-e643-40f7-b3e4-cad62085cbd4 tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f873c40c-170d-4385-a175-7ad3ea8f4973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d9b9e390-e643-40f7-b3e4-cad62085cbd4 tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f873c40c-170d-4385-a175-7ad3ea8f4973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d9b9e390-e643-40f7-b3e4-cad62085cbd4 tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8b04ea7-7775-438d-b047-badb05afad29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:33 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-d9b9e390-e643-40f7-b3e4-cad62085cbd4 tempest-CreateVolumesFromImageTest-611315179 None] Volume 0c8e43f1-4362-43c8-9de9-2995edcf9bb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c8e43f1-4362-43c8-9de9-2995edcf9bb1', 'volume_size': 1}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d9b9e390-e643-40f7-b3e4-cad62085cbd4 tempest-CreateVolumesFromImageTest-611315179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-81a5fbc9-c407-4cc6-91ff-928e2588624e tempest-CreateVolumesFromImageTest-611315179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-81a5fbc9-c407-4cc6-91ff-928e2588624e tempest-CreateVolumesFromImageTest-611315179 None] Flow 'volume_create_manager' (a891098c-cefc-4f0c-99ac-8040b9aa2ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-81a5fbc9-c407-4cc6-91ff-928e2588624e tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d849f7-8fe6-4ea6-b4cc-6266907e3008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-81a5fbc9-c407-4cc6-91ff-928e2588624e tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d849f7-8fe6-4ea6-b4cc-6266907e3008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1631238383',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b040d6-e6b5-4212-8c4e-a1d268ca679a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae43fdb783d4e418675b7fb6883a13c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:34Z,use_quota=True,user_id='63ec4c8d2c794130b79968506dfafc42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-81a5fbc9-c407-4cc6-91ff-928e2588624e tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b59b3d-aa99-40e4-8c04-7217e38a5c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-81a5fbc9-c407-4cc6-91ff-928e2588624e tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b59b3d-aa99-40e4-8c04-7217e38a5c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-81a5fbc9-c407-4cc6-91ff-928e2588624e tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54d234bc-c630-41e0-9610-816e950be0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-81a5fbc9-c407-4cc6-91ff-928e2588624e tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54d234bc-c630-41e0-9610-816e950be0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06b040d6-e6b5-4212-8c4e-a1d268ca679a', 'volume_name': 'volume-06b040d6-e6b5-4212-8c4e-a1d268ca679a', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-81a5fbc9-c407-4cc6-91ff-928e2588624e tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0162ec96-a451-4045-a607-0ae9e7b38d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-81a5fbc9-c407-4cc6-91ff-928e2588624e tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0162ec96-a451-4045-a607-0ae9e7b38d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-81a5fbc9-c407-4cc6-91ff-928e2588624e tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba18be5-31a5-4e26-91c8-9a81d032e056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:33 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-81a5fbc9-c407-4cc6-91ff-928e2588624e tempest-CreateVolumesFromImageTest-611315179 None] Volume 06b040d6-e6b5-4212-8c4e-a1d268ca679a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06b040d6-e6b5-4212-8c4e-a1d268ca679a', 'volume_size': 1}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-81a5fbc9-c407-4cc6-91ff-928e2588624e tempest-CreateVolumesFromImageTest-611315179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-f97714cb-210b-4ed5-822c-f3627bc4194b tempest-CreateVolumesFromImageTest-611315179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f97714cb-210b-4ed5-822c-f3627bc4194b tempest-CreateVolumesFromImageTest-611315179 None] Flow 'volume_create_manager' (861cab98-b8bd-4e78-9104-5d92dc3a39a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f97714cb-210b-4ed5-822c-f3627bc4194b tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91164b21-ac31-42be-a291-c1508be719d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f97714cb-210b-4ed5-822c-f3627bc4194b tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91164b21-ac31-42be-a291-c1508be719d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2001461045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cad04373-9703-4547-be5f-56e32dd65caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae43fdb783d4e418675b7fb6883a13c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:34Z,use_quota=True,user_id='63ec4c8d2c794130b79968506dfafc42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f97714cb-210b-4ed5-822c-f3627bc4194b tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb8a7d8-916a-4ae7-b027-4278e226bb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f97714cb-210b-4ed5-822c-f3627bc4194b tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb8a7d8-916a-4ae7-b027-4278e226bb3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f97714cb-210b-4ed5-822c-f3627bc4194b tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a1d100b-ff7a-448d-bde9-b1d2d67a5798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f97714cb-210b-4ed5-822c-f3627bc4194b tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a1d100b-ff7a-448d-bde9-b1d2d67a5798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cad04373-9703-4547-be5f-56e32dd65caa', 'volume_name': 'volume-cad04373-9703-4547-be5f-56e32dd65caa', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f97714cb-210b-4ed5-822c-f3627bc4194b tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f90d4734-3ffd-4c3e-95a4-479f33e40f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:33 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f97714cb-210b-4ed5-822c-f3627bc4194b tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f90d4734-3ffd-4c3e-95a4-479f33e40f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f97714cb-210b-4ed5-822c-f3627bc4194b tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa9e894-c21b-44dd-ad8b-446c4cd8e450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:33 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-f97714cb-210b-4ed5-822c-f3627bc4194b tempest-CreateVolumesFromImageTest-611315179 None] Volume cad04373-9703-4547-be5f-56e32dd65caa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cad04373-9703-4547-be5f-56e32dd65caa', 'volume_size': 1}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f97714cb-210b-4ed5-822c-f3627bc4194b tempest-CreateVolumesFromImageTest-611315179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-edd1ab8e-b060-4440-8580-45ae7d427040 tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f 1073741824" returned: 0 in 0.763s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-edd1ab8e-b060-4440-8580-45ae7d427040 tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:33 devstack sudo[89826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f
Apr 02 10:34:33 devstack sudo[89826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9a26788-6c36-4a07-9832-5c8687407f33 tempest-CreateVolumesFromImageTest-611315179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f9a26788-6c36-4a07-9832-5c8687407f33 tempest-CreateVolumesFromImageTest-611315179 None] Flow 'volume_create_manager' (7850fb01-0ef3-4ff6-9f16-a9548824e119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f9a26788-6c36-4a07-9832-5c8687407f33 tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3329d1c7-af71-4160-a73a-f5deeb508a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f9a26788-6c36-4a07-9832-5c8687407f33 tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3329d1c7-af71-4160-a73a-f5deeb508a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2087780304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89015713-18de-4d83-83b4-9ca26deda2b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae43fdb783d4e418675b7fb6883a13c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:34Z,use_quota=True,user_id='63ec4c8d2c794130b79968506dfafc42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f9a26788-6c36-4a07-9832-5c8687407f33 tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20702431-27f5-498d-a244-38860d557bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f9a26788-6c36-4a07-9832-5c8687407f33 tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20702431-27f5-498d-a244-38860d557bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f9a26788-6c36-4a07-9832-5c8687407f33 tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4666d1d-fde0-4f78-9d93-3eb9c04464f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f9a26788-6c36-4a07-9832-5c8687407f33 tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4666d1d-fde0-4f78-9d93-3eb9c04464f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89015713-18de-4d83-83b4-9ca26deda2b0', 'volume_name': 'volume-89015713-18de-4d83-83b4-9ca26deda2b0', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f9a26788-6c36-4a07-9832-5c8687407f33 tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279c34b4-9d04-4e42-aa1d-1977203d9f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f9a26788-6c36-4a07-9832-5c8687407f33 tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279c34b4-9d04-4e42-aa1d-1977203d9f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f9a26788-6c36-4a07-9832-5c8687407f33 tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71bdc631-6d77-4195-95c1-ba828876abff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:34 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-f9a26788-6c36-4a07-9832-5c8687407f33 tempest-CreateVolumesFromImageTest-611315179 None] Volume 89015713-18de-4d83-83b4-9ca26deda2b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89015713-18de-4d83-83b4-9ca26deda2b0', 'volume_size': 1}
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f9a26788-6c36-4a07-9832-5c8687407f33 tempest-CreateVolumesFromImageTest-611315179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6f43cda-2867-402d-93ec-6259e5495b88 tempest-CreateVolumesFromImageTest-611315179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b6f43cda-2867-402d-93ec-6259e5495b88 tempest-CreateVolumesFromImageTest-611315179 None] Flow 'volume_create_manager' (34e70d1b-d815-4ab2-8064-0a71b901343d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b6f43cda-2867-402d-93ec-6259e5495b88 tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2682a1dc-6ea1-4c52-8c23-530c7ecdaaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b6f43cda-2867-402d-93ec-6259e5495b88 tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2682a1dc-6ea1-4c52-8c23-530c7ecdaaad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1493840205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0c89fce-28f1-42c0-926c-7e58b5438f84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae43fdb783d4e418675b7fb6883a13c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:34Z,use_quota=True,user_id='63ec4c8d2c794130b79968506dfafc42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b6f43cda-2867-402d-93ec-6259e5495b88 tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (821a0ed1-1b7a-4d9d-bc55-d6815ab0889d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b6f43cda-2867-402d-93ec-6259e5495b88 tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (821a0ed1-1b7a-4d9d-bc55-d6815ab0889d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b6f43cda-2867-402d-93ec-6259e5495b88 tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e292fa31-2900-4628-964f-d229e8ac92e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b6f43cda-2867-402d-93ec-6259e5495b88 tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e292fa31-2900-4628-964f-d229e8ac92e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0c89fce-28f1-42c0-926c-7e58b5438f84', 'volume_name': 'volume-c0c89fce-28f1-42c0-926c-7e58b5438f84', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b6f43cda-2867-402d-93ec-6259e5495b88 tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f50991-ba9a-4860-bbd3-fc9e2fb5a274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b6f43cda-2867-402d-93ec-6259e5495b88 tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f50991-ba9a-4860-bbd3-fc9e2fb5a274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b6f43cda-2867-402d-93ec-6259e5495b88 tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f05f140-2147-44be-96cb-accbbb654e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:34 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-b6f43cda-2867-402d-93ec-6259e5495b88 tempest-CreateVolumesFromImageTest-611315179 None] Volume c0c89fce-28f1-42c0-926c-7e58b5438f84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0c89fce-28f1-42c0-926c-7e58b5438f84', 'volume_size': 1}
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-b6f43cda-2867-402d-93ec-6259e5495b88 tempest-CreateVolumesFromImageTest-611315179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:34 devstack sudo[89826]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-edd1ab8e-b060-4440-8580-45ae7d427040 tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f" returned: 0 in 0.515s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-edd1ab8e-b060-4440-8580-45ae7d427040 tempest-CreateVolumesFromSnapshotTest-389980398 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-edd1ab8e-b060-4440-8580-45ae7d427040 tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-255c8fcc-8d3a-432e-a0d2-375a9ad64940 tempest-VolumeDependencyTests-1466340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.179s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-255c8fcc-8d3a-432e-a0d2-375a9ad64940 tempest-VolumeDependencyTests-1466340 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-50496807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=969474f1-5ffe-4167-8ae9-a9354bcca1d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e1353b5f6e343c0896535424f8300ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:33Z,use_quota=True,user_id='afea7cd197ef4f3c9f4a091988c19f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-255c8fcc-8d3a-432e-a0d2-375a9ad64940 tempest-VolumeDependencyTests-1466340 None] Creating volume 969474f1-5ffe-4167-8ae9-a9354bcca1d4 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-255c8fcc-8d3a-432e-a0d2-375a9ad64940 tempest-VolumeDependencyTests-1466340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-255c8fcc-8d3a-432e-a0d2-375a9ad64940 tempest-VolumeDependencyTests-1466340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-255c8fcc-8d3a-432e-a0d2-375a9ad64940 tempest-VolumeDependencyTests-1466340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-255c8fcc-8d3a-432e-a0d2-375a9ad64940 tempest-VolumeDependencyTests-1466340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-255c8fcc-8d3a-432e-a0d2-375a9ad64940 tempest-VolumeDependencyTests-1466340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-255c8fcc-8d3a-432e-a0d2-375a9ad64940 tempest-VolumeDependencyTests-1466340 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:34:34 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-255c8fcc-8d3a-432e-a0d2-375a9ad64940 tempest-VolumeDependencyTests-1466340 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-255c8fcc-8d3a-432e-a0d2-375a9ad64940 tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:34 devstack sudo[89829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4 1073741824
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-edd1ab8e-b060-4440-8580-45ae7d427040 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f9137ff-014f-4cc7-870c-611774de1b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eca8bd5-c14a-46bd-8629-0b649acd773f', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:34 devstack sudo[89829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-edd1ab8e-b060-4440-8580-45ae7d427040 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f889c6c-7233-4ac8-a5fe-6313f40ab553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:34 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-edd1ab8e-b060-4440-8580-45ae7d427040 tempest-CreateVolumesFromSnapshotTest-389980398 None] Volume volume-8eca8bd5-c14a-46bd-8629-0b649acd773f (8eca8bd5-c14a-46bd-8629-0b649acd773f): created successfully
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-edd1ab8e-b060-4440-8580-45ae7d427040 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f889c6c-7233-4ac8-a5fe-6313f40ab553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-edd1ab8e-b060-4440-8580-45ae7d427040 tempest-CreateVolumesFromSnapshotTest-389980398 None] Flow 'volume_create_manager' (c7296cca-127b-46f4-80d1-78f3852cec2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:34:34 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-edd1ab8e-b060-4440-8580-45ae7d427040 tempest-CreateVolumesFromSnapshotTest-389980398 None] Created volume successfully.
Apr 02 10:34:34 devstack sudo[89829]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-255c8fcc-8d3a-432e-a0d2-375a9ad64940 tempest-VolumeDependencyTests-1466340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4 1073741824" returned: 0 in 0.523s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-255c8fcc-8d3a-432e-a0d2-375a9ad64940 tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:35 devstack sudo[89834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4
Apr 02 10:34:35 devstack sudo[89834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-0db47829-d39b-43a9-9fae-b6488b02b08f tempest-CreateVolumesFromSnapshotTest-389980398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:35 devstack sudo[89834]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-255c8fcc-8d3a-432e-a0d2-375a9ad64940 tempest-VolumeDependencyTests-1466340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4" returned: 0 in 0.534s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:35 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-255c8fcc-8d3a-432e-a0d2-375a9ad64940 tempest-VolumeDependencyTests-1466340 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:34:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-255c8fcc-8d3a-432e-a0d2-375a9ad64940 tempest-VolumeDependencyTests-1466340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d9b9e390-e643-40f7-b3e4-cad62085cbd4 tempest-CreateVolumesFromImageTest-611315179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.109s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:35 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d9b9e390-e643-40f7-b3e4-cad62085cbd4 tempest-CreateVolumesFromImageTest-611315179 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-456723341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c8e43f1-4362-43c8-9de9-2995edcf9bb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae43fdb783d4e418675b7fb6883a13c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:33Z,use_quota=True,user_id='63ec4c8d2c794130b79968506dfafc42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:34:35 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-d9b9e390-e643-40f7-b3e4-cad62085cbd4 tempest-CreateVolumesFromImageTest-611315179 None] Creating volume 0c8e43f1-4362-43c8-9de9-2995edcf9bb1 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:34:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d9b9e390-e643-40f7-b3e4-cad62085cbd4 tempest-CreateVolumesFromImageTest-611315179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d9b9e390-e643-40f7-b3e4-cad62085cbd4 tempest-CreateVolumesFromImageTest-611315179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:35 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d9b9e390-e643-40f7-b3e4-cad62085cbd4 tempest-CreateVolumesFromImageTest-611315179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:34:35 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d9b9e390-e643-40f7-b3e4-cad62085cbd4 tempest-CreateVolumesFromImageTest-611315179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:34:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d9b9e390-e643-40f7-b3e4-cad62085cbd4 tempest-CreateVolumesFromImageTest-611315179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:35 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d9b9e390-e643-40f7-b3e4-cad62085cbd4 tempest-CreateVolumesFromImageTest-611315179 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:34:35 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-d9b9e390-e643-40f7-b3e4-cad62085cbd4 tempest-CreateVolumesFromImageTest-611315179 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:34:35 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d9b9e390-e643-40f7-b3e4-cad62085cbd4 tempest-CreateVolumesFromImageTest-611315179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-0c8e43f1-4362-43c8-9de9-2995edcf9bb1 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:35 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-255c8fcc-8d3a-432e-a0d2-375a9ad64940 tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c39c5278-c98e-40a4-9f17-6074dd72c05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:35 devstack sudo[89837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-0c8e43f1-4362-43c8-9de9-2995edcf9bb1 1073741824
Apr 02 10:34:35 devstack sudo[89837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:35 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-255c8fcc-8d3a-432e-a0d2-375a9ad64940 tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87c6dfd4-c602-4bde-88f8-a44e1d3ecf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:35 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-255c8fcc-8d3a-432e-a0d2-375a9ad64940 tempest-VolumeDependencyTests-1466340 None] Volume volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4 (969474f1-5ffe-4167-8ae9-a9354bcca1d4): created successfully
Apr 02 10:34:35 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-255c8fcc-8d3a-432e-a0d2-375a9ad64940 tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87c6dfd4-c602-4bde-88f8-a44e1d3ecf21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:35 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-255c8fcc-8d3a-432e-a0d2-375a9ad64940 tempest-VolumeDependencyTests-1466340 None] Flow 'volume_create_manager' (58cbd530-3322-4f62-89df-c8cbc5298fe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:34:35 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-255c8fcc-8d3a-432e-a0d2-375a9ad64940 tempest-VolumeDependencyTests-1466340 None] Created volume successfully.
Apr 02 10:34:36 devstack sudo[89837]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d9b9e390-e643-40f7-b3e4-cad62085cbd4 tempest-CreateVolumesFromImageTest-611315179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-0c8e43f1-4362-43c8-9de9-2995edcf9bb1 1073741824" returned: 0 in 0.517s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d9b9e390-e643-40f7-b3e4-cad62085cbd4 tempest-CreateVolumesFromImageTest-611315179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-0c8e43f1-4362-43c8-9de9-2995edcf9bb1 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:36 devstack sudo[89842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-0c8e43f1-4362-43c8-9de9-2995edcf9bb1
Apr 02 10:34:36 devstack sudo[89842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-842d73bd-cca3-41a2-baf4-757dc94913df tempest-VolumeDependencyTests-1466340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:36 devstack sudo[89842]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d9b9e390-e643-40f7-b3e4-cad62085cbd4 tempest-CreateVolumesFromImageTest-611315179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-0c8e43f1-4362-43c8-9de9-2995edcf9bb1" returned: 0 in 0.442s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:36 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d9b9e390-e643-40f7-b3e4-cad62085cbd4 tempest-CreateVolumesFromImageTest-611315179 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:34:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d9b9e390-e643-40f7-b3e4-cad62085cbd4 tempest-CreateVolumesFromImageTest-611315179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-81a5fbc9-c407-4cc6-91ff-928e2588624e tempest-CreateVolumesFromImageTest-611315179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.865s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:36 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-81a5fbc9-c407-4cc6-91ff-928e2588624e tempest-CreateVolumesFromImageTest-611315179 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1631238383',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b040d6-e6b5-4212-8c4e-a1d268ca679a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae43fdb783d4e418675b7fb6883a13c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:34Z,use_quota=True,user_id='63ec4c8d2c794130b79968506dfafc42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:34:36 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-81a5fbc9-c407-4cc6-91ff-928e2588624e tempest-CreateVolumesFromImageTest-611315179 None] Creating volume 06b040d6-e6b5-4212-8c4e-a1d268ca679a {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:34:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-81a5fbc9-c407-4cc6-91ff-928e2588624e tempest-CreateVolumesFromImageTest-611315179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-81a5fbc9-c407-4cc6-91ff-928e2588624e tempest-CreateVolumesFromImageTest-611315179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:36 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-81a5fbc9-c407-4cc6-91ff-928e2588624e tempest-CreateVolumesFromImageTest-611315179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:34:36 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-81a5fbc9-c407-4cc6-91ff-928e2588624e tempest-CreateVolumesFromImageTest-611315179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:34:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-81a5fbc9-c407-4cc6-91ff-928e2588624e tempest-CreateVolumesFromImageTest-611315179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:36 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-81a5fbc9-c407-4cc6-91ff-928e2588624e tempest-CreateVolumesFromImageTest-611315179 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:34:36 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-81a5fbc9-c407-4cc6-91ff-928e2588624e tempest-CreateVolumesFromImageTest-611315179 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:34:36 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-81a5fbc9-c407-4cc6-91ff-928e2588624e tempest-CreateVolumesFromImageTest-611315179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-06b040d6-e6b5-4212-8c4e-a1d268ca679a 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d9b9e390-e643-40f7-b3e4-cad62085cbd4 tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8b04ea7-7775-438d-b047-badb05afad29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c8e43f1-4362-43c8-9de9-2995edcf9bb1', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d9b9e390-e643-40f7-b3e4-cad62085cbd4 tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5871069a-c2c9-4616-9d72-3cb9fbf66cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:36 devstack sudo[89845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-06b040d6-e6b5-4212-8c4e-a1d268ca679a 1073741824
Apr 02 10:34:36 devstack sudo[89845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:36 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-d9b9e390-e643-40f7-b3e4-cad62085cbd4 tempest-CreateVolumesFromImageTest-611315179 None] Volume volume-0c8e43f1-4362-43c8-9de9-2995edcf9bb1 (0c8e43f1-4362-43c8-9de9-2995edcf9bb1): created successfully
Apr 02 10:34:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d9b9e390-e643-40f7-b3e4-cad62085cbd4 tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5871069a-c2c9-4616-9d72-3cb9fbf66cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:36 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d9b9e390-e643-40f7-b3e4-cad62085cbd4 tempest-CreateVolumesFromImageTest-611315179 None] Flow 'volume_create_manager' (a0c7d441-447d-4add-98ea-b065a2fecf20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:34:36 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-d9b9e390-e643-40f7-b3e4-cad62085cbd4 tempest-CreateVolumesFromImageTest-611315179 None] Created volume successfully.
Apr 02 10:34:37 devstack sudo[89845]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-81a5fbc9-c407-4cc6-91ff-928e2588624e tempest-CreateVolumesFromImageTest-611315179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-06b040d6-e6b5-4212-8c4e-a1d268ca679a 1073741824" returned: 0 in 0.590s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-81a5fbc9-c407-4cc6-91ff-928e2588624e tempest-CreateVolumesFromImageTest-611315179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-06b040d6-e6b5-4212-8c4e-a1d268ca679a {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:37 devstack sudo[89850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-06b040d6-e6b5-4212-8c4e-a1d268ca679a
Apr 02 10:34:37 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:37 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-81a5fbc9-c407-4cc6-91ff-928e2588624e tempest-CreateVolumesFromImageTest-611315179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-06b040d6-e6b5-4212-8c4e-a1d268ca679a" returned: 0 in 0.450s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:37 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-81a5fbc9-c407-4cc6-91ff-928e2588624e tempest-CreateVolumesFromImageTest-611315179 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:34:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-81a5fbc9-c407-4cc6-91ff-928e2588624e tempest-CreateVolumesFromImageTest-611315179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f97714cb-210b-4ed5-822c-f3627bc4194b tempest-CreateVolumesFromImageTest-611315179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.712s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:37 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f97714cb-210b-4ed5-822c-f3627bc4194b tempest-CreateVolumesFromImageTest-611315179 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2001461045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cad04373-9703-4547-be5f-56e32dd65caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae43fdb783d4e418675b7fb6883a13c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:34Z,use_quota=True,user_id='63ec4c8d2c794130b79968506dfafc42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:34:37 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-f97714cb-210b-4ed5-822c-f3627bc4194b tempest-CreateVolumesFromImageTest-611315179 None] Creating volume cad04373-9703-4547-be5f-56e32dd65caa {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:34:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f97714cb-210b-4ed5-822c-f3627bc4194b tempest-CreateVolumesFromImageTest-611315179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f97714cb-210b-4ed5-822c-f3627bc4194b tempest-CreateVolumesFromImageTest-611315179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:37 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f97714cb-210b-4ed5-822c-f3627bc4194b tempest-CreateVolumesFromImageTest-611315179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:34:37 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f97714cb-210b-4ed5-822c-f3627bc4194b tempest-CreateVolumesFromImageTest-611315179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:34:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f97714cb-210b-4ed5-822c-f3627bc4194b tempest-CreateVolumesFromImageTest-611315179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:37 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f97714cb-210b-4ed5-822c-f3627bc4194b tempest-CreateVolumesFromImageTest-611315179 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:34:37 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-f97714cb-210b-4ed5-822c-f3627bc4194b tempest-CreateVolumesFromImageTest-611315179 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:34:37 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f97714cb-210b-4ed5-822c-f3627bc4194b tempest-CreateVolumesFromImageTest-611315179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-cad04373-9703-4547-be5f-56e32dd65caa 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:37 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-81a5fbc9-c407-4cc6-91ff-928e2588624e tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba18be5-31a5-4e26-91c8-9a81d032e056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06b040d6-e6b5-4212-8c4e-a1d268ca679a', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:37 devstack sudo[89853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-cad04373-9703-4547-be5f-56e32dd65caa 1073741824
Apr 02 10:34:37 devstack sudo[89853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:37 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-81a5fbc9-c407-4cc6-91ff-928e2588624e tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bac178f-c6bf-4ec1-8ffb-3127288d8def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:37 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-81a5fbc9-c407-4cc6-91ff-928e2588624e tempest-CreateVolumesFromImageTest-611315179 None] Volume volume-06b040d6-e6b5-4212-8c4e-a1d268ca679a (06b040d6-e6b5-4212-8c4e-a1d268ca679a): created successfully
Apr 02 10:34:37 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-81a5fbc9-c407-4cc6-91ff-928e2588624e tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bac178f-c6bf-4ec1-8ffb-3127288d8def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:37 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-81a5fbc9-c407-4cc6-91ff-928e2588624e tempest-CreateVolumesFromImageTest-611315179 None] Flow 'volume_create_manager' (a891098c-cefc-4f0c-99ac-8040b9aa2ee5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:34:37 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-81a5fbc9-c407-4cc6-91ff-928e2588624e tempest-CreateVolumesFromImageTest-611315179 None] Created volume successfully.
Apr 02 10:34:38 devstack sudo[89853]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f97714cb-210b-4ed5-822c-f3627bc4194b tempest-CreateVolumesFromImageTest-611315179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-cad04373-9703-4547-be5f-56e32dd65caa 1073741824" returned: 0 in 0.533s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f97714cb-210b-4ed5-822c-f3627bc4194b tempest-CreateVolumesFromImageTest-611315179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-cad04373-9703-4547-be5f-56e32dd65caa {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:38 devstack sudo[89858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-cad04373-9703-4547-be5f-56e32dd65caa
Apr 02 10:34:38 devstack sudo[89858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:38 devstack sudo[89858]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f97714cb-210b-4ed5-822c-f3627bc4194b tempest-CreateVolumesFromImageTest-611315179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-cad04373-9703-4547-be5f-56e32dd65caa" returned: 0 in 0.495s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:38 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f97714cb-210b-4ed5-822c-f3627bc4194b tempest-CreateVolumesFromImageTest-611315179 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:34:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f97714cb-210b-4ed5-822c-f3627bc4194b tempest-CreateVolumesFromImageTest-611315179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f9a26788-6c36-4a07-9832-5c8687407f33 tempest-CreateVolumesFromImageTest-611315179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.471s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:38 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f9a26788-6c36-4a07-9832-5c8687407f33 tempest-CreateVolumesFromImageTest-611315179 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2087780304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89015713-18de-4d83-83b4-9ca26deda2b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae43fdb783d4e418675b7fb6883a13c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:34Z,use_quota=True,user_id='63ec4c8d2c794130b79968506dfafc42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:34:38 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-f9a26788-6c36-4a07-9832-5c8687407f33 tempest-CreateVolumesFromImageTest-611315179 None] Creating volume 89015713-18de-4d83-83b4-9ca26deda2b0 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:34:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f9a26788-6c36-4a07-9832-5c8687407f33 tempest-CreateVolumesFromImageTest-611315179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f9a26788-6c36-4a07-9832-5c8687407f33 tempest-CreateVolumesFromImageTest-611315179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:38 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f9a26788-6c36-4a07-9832-5c8687407f33 tempest-CreateVolumesFromImageTest-611315179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:34:38 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f9a26788-6c36-4a07-9832-5c8687407f33 tempest-CreateVolumesFromImageTest-611315179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:34:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f9a26788-6c36-4a07-9832-5c8687407f33 tempest-CreateVolumesFromImageTest-611315179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:38 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f9a26788-6c36-4a07-9832-5c8687407f33 tempest-CreateVolumesFromImageTest-611315179 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:34:38 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-f9a26788-6c36-4a07-9832-5c8687407f33 tempest-CreateVolumesFromImageTest-611315179 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:34:38 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f9a26788-6c36-4a07-9832-5c8687407f33 tempest-CreateVolumesFromImageTest-611315179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-89015713-18de-4d83-83b4-9ca26deda2b0 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:38 devstack sudo[89861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-89015713-18de-4d83-83b4-9ca26deda2b0 1073741824
Apr 02 10:34:38 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f97714cb-210b-4ed5-822c-f3627bc4194b tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa9e894-c21b-44dd-ad8b-446c4cd8e450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cad04373-9703-4547-be5f-56e32dd65caa', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:38 devstack sudo[89861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:38 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f97714cb-210b-4ed5-822c-f3627bc4194b tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90c2dcea-3bcf-4c57-8300-7ef2c9d1b57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:38 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-f97714cb-210b-4ed5-822c-f3627bc4194b tempest-CreateVolumesFromImageTest-611315179 None] Volume volume-cad04373-9703-4547-be5f-56e32dd65caa (cad04373-9703-4547-be5f-56e32dd65caa): created successfully
Apr 02 10:34:38 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f97714cb-210b-4ed5-822c-f3627bc4194b tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90c2dcea-3bcf-4c57-8300-7ef2c9d1b57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:38 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f97714cb-210b-4ed5-822c-f3627bc4194b tempest-CreateVolumesFromImageTest-611315179 None] Flow 'volume_create_manager' (861cab98-b8bd-4e78-9104-5d92dc3a39a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:34:38 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-f97714cb-210b-4ed5-822c-f3627bc4194b tempest-CreateVolumesFromImageTest-611315179 None] Created volume successfully.
Apr 02 10:34:39 devstack sudo[89861]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f9a26788-6c36-4a07-9832-5c8687407f33 tempest-CreateVolumesFromImageTest-611315179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-89015713-18de-4d83-83b4-9ca26deda2b0 1073741824" returned: 0 in 0.583s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f9a26788-6c36-4a07-9832-5c8687407f33 tempest-CreateVolumesFromImageTest-611315179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-89015713-18de-4d83-83b4-9ca26deda2b0 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:39 devstack sudo[89866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-89015713-18de-4d83-83b4-9ca26deda2b0
Apr 02 10:34:39 devstack sudo[89866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:39 devstack sudo[89866]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f9a26788-6c36-4a07-9832-5c8687407f33 tempest-CreateVolumesFromImageTest-611315179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-89015713-18de-4d83-83b4-9ca26deda2b0" returned: 0 in 0.475s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:39 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f9a26788-6c36-4a07-9832-5c8687407f33 tempest-CreateVolumesFromImageTest-611315179 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:34:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f9a26788-6c36-4a07-9832-5c8687407f33 tempest-CreateVolumesFromImageTest-611315179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-b6f43cda-2867-402d-93ec-6259e5495b88 tempest-CreateVolumesFromImageTest-611315179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.383s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:39 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-b6f43cda-2867-402d-93ec-6259e5495b88 tempest-CreateVolumesFromImageTest-611315179 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1493840205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0c89fce-28f1-42c0-926c-7e58b5438f84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ae43fdb783d4e418675b7fb6883a13c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:34Z,use_quota=True,user_id='63ec4c8d2c794130b79968506dfafc42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:34:39 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-b6f43cda-2867-402d-93ec-6259e5495b88 tempest-CreateVolumesFromImageTest-611315179 None] Creating volume c0c89fce-28f1-42c0-926c-7e58b5438f84 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:34:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-b6f43cda-2867-402d-93ec-6259e5495b88 tempest-CreateVolumesFromImageTest-611315179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-b6f43cda-2867-402d-93ec-6259e5495b88 tempest-CreateVolumesFromImageTest-611315179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:39 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-b6f43cda-2867-402d-93ec-6259e5495b88 tempest-CreateVolumesFromImageTest-611315179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:34:39 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-b6f43cda-2867-402d-93ec-6259e5495b88 tempest-CreateVolumesFromImageTest-611315179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:34:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-b6f43cda-2867-402d-93ec-6259e5495b88 tempest-CreateVolumesFromImageTest-611315179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:39 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-b6f43cda-2867-402d-93ec-6259e5495b88 tempest-CreateVolumesFromImageTest-611315179 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:34:39 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-b6f43cda-2867-402d-93ec-6259e5495b88 tempest-CreateVolumesFromImageTest-611315179 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:34:39 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b6f43cda-2867-402d-93ec-6259e5495b88 tempest-CreateVolumesFromImageTest-611315179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c0c89fce-28f1-42c0-926c-7e58b5438f84 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:39 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f9a26788-6c36-4a07-9832-5c8687407f33 tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71bdc631-6d77-4195-95c1-ba828876abff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89015713-18de-4d83-83b4-9ca26deda2b0', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:39 devstack sudo[89869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c0c89fce-28f1-42c0-926c-7e58b5438f84 1073741824
Apr 02 10:34:39 devstack sudo[89869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:39 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f9a26788-6c36-4a07-9832-5c8687407f33 tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f78ff2-f537-4ac1-bd2b-fd1351dd5ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:39 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-f9a26788-6c36-4a07-9832-5c8687407f33 tempest-CreateVolumesFromImageTest-611315179 None] Volume volume-89015713-18de-4d83-83b4-9ca26deda2b0 (89015713-18de-4d83-83b4-9ca26deda2b0): created successfully
Apr 02 10:34:39 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f9a26788-6c36-4a07-9832-5c8687407f33 tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f78ff2-f537-4ac1-bd2b-fd1351dd5ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:39 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f9a26788-6c36-4a07-9832-5c8687407f33 tempest-CreateVolumesFromImageTest-611315179 None] Flow 'volume_create_manager' (7850fb01-0ef3-4ff6-9f16-a9548824e119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:34:39 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-f9a26788-6c36-4a07-9832-5c8687407f33 tempest-CreateVolumesFromImageTest-611315179 None] Created volume successfully.
Apr 02 10:34:40 devstack sudo[89869]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b6f43cda-2867-402d-93ec-6259e5495b88 tempest-CreateVolumesFromImageTest-611315179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c0c89fce-28f1-42c0-926c-7e58b5438f84 1073741824" returned: 0 in 0.551s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b6f43cda-2867-402d-93ec-6259e5495b88 tempest-CreateVolumesFromImageTest-611315179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c0c89fce-28f1-42c0-926c-7e58b5438f84 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:40 devstack sudo[89874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c0c89fce-28f1-42c0-926c-7e58b5438f84
Apr 02 10:34:40 devstack sudo[89874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:40 devstack sudo[89874]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-b6f43cda-2867-402d-93ec-6259e5495b88 tempest-CreateVolumesFromImageTest-611315179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c0c89fce-28f1-42c0-926c-7e58b5438f84" returned: 0 in 0.469s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:40 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-b6f43cda-2867-402d-93ec-6259e5495b88 tempest-CreateVolumesFromImageTest-611315179 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:34:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-b6f43cda-2867-402d-93ec-6259e5495b88 tempest-CreateVolumesFromImageTest-611315179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-0db47829-d39b-43a9-9fae-b6488b02b08f tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.561s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:40 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b6f43cda-2867-402d-93ec-6259e5495b88 tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f05f140-2147-44be-96cb-accbbb654e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0c89fce-28f1-42c0-926c-7e58b5438f84', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:40 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b6f43cda-2867-402d-93ec-6259e5495b88 tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83736ea7-5be2-475f-985e-bb53e0a8de71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:40 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-b6f43cda-2867-402d-93ec-6259e5495b88 tempest-CreateVolumesFromImageTest-611315179 None] Volume volume-c0c89fce-28f1-42c0-926c-7e58b5438f84 (c0c89fce-28f1-42c0-926c-7e58b5438f84): created successfully
Apr 02 10:34:40 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b6f43cda-2867-402d-93ec-6259e5495b88 tempest-CreateVolumesFromImageTest-611315179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83736ea7-5be2-475f-985e-bb53e0a8de71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:40 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-b6f43cda-2867-402d-93ec-6259e5495b88 tempest-CreateVolumesFromImageTest-611315179 None] Flow 'volume_create_manager' (34e70d1b-d815-4ab2-8064-0a71b901343d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:34:40 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-0db47829-d39b-43a9-9fae-b6488b02b08f tempest-CreateVolumesFromSnapshotTest-389980398 None] Creating offline snapshot d01f3b11-a010-4e7e-8b41-8d2f9347cd65 of volume 8eca8bd5-c14a-46bd-8629-0b649acd773f {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:34:40 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-b6f43cda-2867-402d-93ec-6259e5495b88 tempest-CreateVolumesFromImageTest-611315179 None] Created volume successfully.
Apr 02 10:34:40 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[26394bec-307e-4883-adc3-a348eedbb588]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:34:40 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0db47829-d39b-43a9-9fae-b6488b02b08f tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:40 devstack sudo[89883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f
Apr 02 10:34:40 devstack sudo[89883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:41 devstack sudo[89883]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0db47829-d39b-43a9-9fae-b6488b02b08f tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f" returned: 0 in 0.551s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:41 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0db47829-d39b-43a9-9fae-b6488b02b08f tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f.d01f3b11-a010-4e7e-8b41-8d2f9347cd65 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:41 devstack sudo[89889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f.d01f3b11-a010-4e7e-8b41-8d2f9347cd65 1G
Apr 02 10:34:41 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:41 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-826c46c4-e92b-45c4-8c93-7df25cfc30e5 tempest-CreateVolumesFromImageTest-611315179 None] Acquiring lock "cinder-c0c89fce-28f1-42c0-926c-7e58b5438f84-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:41 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-826c46c4-e92b-45c4-8c93-7df25cfc30e5 tempest-CreateVolumesFromImageTest-611315179 None] Lock "cinder-c0c89fce-28f1-42c0-926c-7e58b5438f84-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:42 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-826c46c4-e92b-45c4-8c93-7df25cfc30e5 tempest-CreateVolumesFromImageTest-611315179 None] Acquiring lock "cinder-quobyte-c0c89fce-28f1-42c0-926c-7e58b5438f84" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:42 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-826c46c4-e92b-45c4-8c93-7df25cfc30e5 tempest-CreateVolumesFromImageTest-611315179 None] Lock "cinder-quobyte-c0c89fce-28f1-42c0-926c-7e58b5438f84" acquired by "delete_volume" :: waited 0.012s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:42 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9de9ce5-061d-4146-bfd8-42ba8fec9e62]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:34:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-826c46c4-e92b-45c4-8c93-7df25cfc30e5 tempest-CreateVolumesFromImageTest-611315179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c0c89fce-28f1-42c0-926c-7e58b5438f84 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:42 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0db47829-d39b-43a9-9fae-b6488b02b08f tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f.d01f3b11-a010-4e7e-8b41-8d2f9347cd65 1G" returned: 0 in 0.618s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0db47829-d39b-43a9-9fae-b6488b02b08f tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8eca8bd5-c14a-46bd-8629-0b649acd773f -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f.d01f3b11-a010-4e7e-8b41-8d2f9347cd65 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:42 devstack sudo[89895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8eca8bd5-c14a-46bd-8629-0b649acd773f -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f.d01f3b11-a010-4e7e-8b41-8d2f9347cd65
Apr 02 10:34:42 devstack sudo[89895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:42 devstack sudo[89894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c0c89fce-28f1-42c0-926c-7e58b5438f84
Apr 02 10:34:42 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:42 devstack sudo[89895]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0db47829-d39b-43a9-9fae-b6488b02b08f tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8eca8bd5-c14a-46bd-8629-0b649acd773f -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f.d01f3b11-a010-4e7e-8b41-8d2f9347cd65" returned: 0 in 0.484s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:42 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-0db47829-d39b-43a9-9fae-b6488b02b08f tempest-CreateVolumesFromSnapshotTest-389980398 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f.d01f3b11-a010-4e7e-8b41-8d2f9347cd65 is being set with open permissions: ugo+rw
Apr 02 10:34:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0db47829-d39b-43a9-9fae-b6488b02b08f tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f.d01f3b11-a010-4e7e-8b41-8d2f9347cd65 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:42 devstack sudo[89904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f.d01f3b11-a010-4e7e-8b41-8d2f9347cd65
Apr 02 10:34:42 devstack sudo[89904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:42 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-826c46c4-e92b-45c4-8c93-7df25cfc30e5 tempest-CreateVolumesFromImageTest-611315179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c0c89fce-28f1-42c0-926c-7e58b5438f84" returned: 0 in 0.572s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:42 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-826c46c4-e92b-45c4-8c93-7df25cfc30e5 tempest-CreateVolumesFromImageTest-611315179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c0c89fce-28f1-42c0-926c-7e58b5438f84 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:42 devstack sudo[89906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c0c89fce-28f1-42c0-926c-7e58b5438f84
Apr 02 10:34:42 devstack sudo[89906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:43 devstack sudo[89904]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0db47829-d39b-43a9-9fae-b6488b02b08f tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f.d01f3b11-a010-4e7e-8b41-8d2f9347cd65" returned: 0 in 0.451s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0db47829-d39b-43a9-9fae-b6488b02b08f tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:43 devstack sudo[89906]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-826c46c4-e92b-45c4-8c93-7df25cfc30e5 tempest-CreateVolumesFromImageTest-611315179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-c0c89fce-28f1-42c0-926c-7e58b5438f84" returned: 0 in 0.431s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:43 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-826c46c4-e92b-45c4-8c93-7df25cfc30e5 tempest-CreateVolumesFromImageTest-611315179 None] Lock "cinder-quobyte-c0c89fce-28f1-42c0-926c-7e58b5438f84" released by "delete_volume" :: held 1.029s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:34:43 devstack sudo[89910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f.info
Apr 02 10:34:43 devstack sudo[89910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:43 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-826c46c4-e92b-45c4-8c93-7df25cfc30e5 tempest-CreateVolumesFromImageTest-611315179 None] Created reservations ['1b5db3ac-e05a-40c4-8b72-dc97caf6b61a', '24dc6c67-8a83-45e1-8e1d-64e5aca674cc', 'f40c914b-bcda-42e5-85a4-ef8639823c54', '2b95ed72-b54d-4f7c-bfdc-e1ae0876a724'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:34:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-826c46c4-e92b-45c4-8c93-7df25cfc30e5 tempest-CreateVolumesFromImageTest-611315179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-826c46c4-e92b-45c4-8c93-7df25cfc30e5 tempest-CreateVolumesFromImageTest-611315179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:43 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-826c46c4-e92b-45c4-8c93-7df25cfc30e5 tempest-CreateVolumesFromImageTest-611315179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:34:43 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-826c46c4-e92b-45c4-8c93-7df25cfc30e5 tempest-CreateVolumesFromImageTest-611315179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:34:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-826c46c4-e92b-45c4-8c93-7df25cfc30e5 tempest-CreateVolumesFromImageTest-611315179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-826c46c4-e92b-45c4-8c93-7df25cfc30e5 tempest-CreateVolumesFromImageTest-611315179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:43 devstack sudo[89912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:34:43 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:43 devstack sudo[89910]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0db47829-d39b-43a9-9fae-b6488b02b08f tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f.info" returned: 0 in 0.446s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:43 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-0db47829-d39b-43a9-9fae-b6488b02b08f tempest-CreateVolumesFromSnapshotTest-389980398 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f.info is being set with open permissions: ugo+rw
Apr 02 10:34:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0db47829-d39b-43a9-9fae-b6488b02b08f tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:43 devstack sudo[89915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f.info
Apr 02 10:34:43 devstack sudo[89915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:43 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-826c46c4-e92b-45c4-8c93-7df25cfc30e5 tempest-CreateVolumesFromImageTest-611315179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.466s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:43 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-826c46c4-e92b-45c4-8c93-7df25cfc30e5 tempest-CreateVolumesFromImageTest-611315179 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:34:43 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-826c46c4-e92b-45c4-8c93-7df25cfc30e5 tempest-CreateVolumesFromImageTest-611315179 None] Deleted volume successfully.
Apr 02 10:34:43 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-826c46c4-e92b-45c4-8c93-7df25cfc30e5 tempest-CreateVolumesFromImageTest-611315179 None] Lock "cinder-c0c89fce-28f1-42c0-926c-7e58b5438f84-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:34:43 devstack sudo[89915]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0db47829-d39b-43a9-9fae-b6488b02b08f tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f.info" returned: 0 in 0.447s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-0db47829-d39b-43a9-9fae-b6488b02b08f tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.094s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-842d73bd-cca3-41a2-baf4-757dc94913df tempest-VolumeDependencyTests-1466340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.509s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:43 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-842d73bd-cca3-41a2-baf4-757dc94913df tempest-VolumeDependencyTests-1466340 None] Creating offline snapshot d31db937-6e4c-456b-8967-94d7f696268c of volume 969474f1-5ffe-4167-8ae9-a9354bcca1d4 {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:34:43 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f0517d-b385-4056-884e-949fb45a0e74]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:34:43 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-842d73bd-cca3-41a2-baf4-757dc94913df tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:43 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-0db47829-d39b-43a9-9fae-b6488b02b08f tempest-CreateVolumesFromSnapshotTest-389980398 None] Create snapshot completed successfully
Apr 02 10:34:44 devstack sudo[89919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4
Apr 02 10:34:44 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:44 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9dcaa4dc-ab04-4e1e-aec0-a2db9f15e0b3 tempest-CreateVolumesFromImageTest-611315179 None] Acquiring lock "cinder-89015713-18de-4d83-83b4-9ca26deda2b0-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:44 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9dcaa4dc-ab04-4e1e-aec0-a2db9f15e0b3 tempest-CreateVolumesFromImageTest-611315179 None] Lock "cinder-89015713-18de-4d83-83b4-9ca26deda2b0-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:44 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9dcaa4dc-ab04-4e1e-aec0-a2db9f15e0b3 tempest-CreateVolumesFromImageTest-611315179 None] Acquiring lock "cinder-quobyte-89015713-18de-4d83-83b4-9ca26deda2b0" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:44 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9dcaa4dc-ab04-4e1e-aec0-a2db9f15e0b3 tempest-CreateVolumesFromImageTest-611315179 None] Lock "cinder-quobyte-89015713-18de-4d83-83b4-9ca26deda2b0" acquired by "delete_volume" :: waited 0.013s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:44 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7e8ddb-58b7-46fa-b595-55e2ea17a518]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:34:44 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9dcaa4dc-ab04-4e1e-aec0-a2db9f15e0b3 tempest-CreateVolumesFromImageTest-611315179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-89015713-18de-4d83-83b4-9ca26deda2b0 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:44 devstack sudo[89921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-89015713-18de-4d83-83b4-9ca26deda2b0
Apr 02 10:34:44 devstack sudo[89921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:44 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:44 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-842d73bd-cca3-41a2-baf4-757dc94913df tempest-VolumeDependencyTests-1466340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4" returned: 0 in 0.517s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:44 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-842d73bd-cca3-41a2-baf4-757dc94913df tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4.d31db937-6e4c-456b-8967-94d7f696268c 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:44 devstack sudo[89926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4.d31db937-6e4c-456b-8967-94d7f696268c 1G
Apr 02 10:34:44 devstack sudo[89926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:44 devstack sudo[89921]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:44 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9dcaa4dc-ab04-4e1e-aec0-a2db9f15e0b3 tempest-CreateVolumesFromImageTest-611315179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-89015713-18de-4d83-83b4-9ca26deda2b0" returned: 0 in 0.581s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:44 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9dcaa4dc-ab04-4e1e-aec0-a2db9f15e0b3 tempest-CreateVolumesFromImageTest-611315179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-89015713-18de-4d83-83b4-9ca26deda2b0 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:44 devstack sudo[89931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-89015713-18de-4d83-83b4-9ca26deda2b0
Apr 02 10:34:44 devstack sudo[89931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:44 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac415b30-ac99-421d-a02e-bc034199d4b8 tempest-CreateVolumesFromSnapshotTest-389980398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:34:44 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ac415b30-ac99-421d-a02e-bc034199d4b8 tempest-CreateVolumesFromSnapshotTest-389980398 None] Flow 'volume_create_manager' (d6ebfba2-2ca6-4a27-9fdd-bf820e9dd842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:34:44 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ac415b30-ac99-421d-a02e-bc034199d4b8 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11b9da2a-2e55-4e35-9f4f-43a5794380dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ac415b30-ac99-421d-a02e-bc034199d4b8 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11b9da2a-2e55-4e35-9f4f-43a5794380dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2051733126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aec8915-3aee-44a5-aa50-389469d46121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3ec0d897f864fd48c73c167d0e04a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:45Z,use_quota=True,user_id='3704a8c936c648b8acf521c70085dff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:45 devstack sudo[89926]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ac415b30-ac99-421d-a02e-bc034199d4b8 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d89280cb-d4a9-49e5-a1ba-cca7938272e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ac415b30-ac99-421d-a02e-bc034199d4b8 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d89280cb-d4a9-49e5-a1ba-cca7938272e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ac415b30-ac99-421d-a02e-bc034199d4b8 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88c5ee3e-0cc8-40a5-b3d3-90dcae235b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ac415b30-ac99-421d-a02e-bc034199d4b8 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88c5ee3e-0cc8-40a5-b3d3-90dcae235b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8aec8915-3aee-44a5-aa50-389469d46121', 'volume_name': 'volume-8aec8915-3aee-44a5-aa50-389469d46121', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ac415b30-ac99-421d-a02e-bc034199d4b8 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7fe349a-9af1-48f2-9ca2-1493d94cdf6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ac415b30-ac99-421d-a02e-bc034199d4b8 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7fe349a-9af1-48f2-9ca2-1493d94cdf6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ac415b30-ac99-421d-a02e-bc034199d4b8 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f58824c-0d79-4cfb-b985-c8389ed37cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:45 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-ac415b30-ac99-421d-a02e-bc034199d4b8 tempest-CreateVolumesFromSnapshotTest-389980398 None] Volume 8aec8915-3aee-44a5-aa50-389469d46121: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8aec8915-3aee-44a5-aa50-389469d46121', 'volume_size': 1}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ac415b30-ac99-421d-a02e-bc034199d4b8 tempest-CreateVolumesFromSnapshotTest-389980398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-842d73bd-cca3-41a2-baf4-757dc94913df tempest-VolumeDependencyTests-1466340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4.d31db937-6e4c-456b-8967-94d7f696268c 1G" returned: 0 in 0.617s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-842d73bd-cca3-41a2-baf4-757dc94913df tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4.d31db937-6e4c-456b-8967-94d7f696268c {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:45 devstack sudo[89936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4.d31db937-6e4c-456b-8967-94d7f696268c
Apr 02 10:34:45 devstack sudo[89936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-f665042f-c288-4bb7-8618-41abe6a6eb6d tempest-CreateVolumesFromSnapshotTest-389980398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f665042f-c288-4bb7-8618-41abe6a6eb6d tempest-CreateVolumesFromSnapshotTest-389980398 None] Flow 'volume_create_manager' (79a6cc59-ee83-462a-926b-ec12c01c292d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f665042f-c288-4bb7-8618-41abe6a6eb6d tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6080ce1-9c5d-4ac3-9180-f234f9301792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f665042f-c288-4bb7-8618-41abe6a6eb6d tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6080ce1-9c5d-4ac3-9180-f234f9301792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-186393557',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34c8b1fe-4417-4843-8e7c-e5beff9bb3a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3ec0d897f864fd48c73c167d0e04a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:45Z,use_quota=True,user_id='3704a8c936c648b8acf521c70085dff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f665042f-c288-4bb7-8618-41abe6a6eb6d tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (871f8520-d217-4ec6-909e-a97a1cf72fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f665042f-c288-4bb7-8618-41abe6a6eb6d tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (871f8520-d217-4ec6-909e-a97a1cf72fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f665042f-c288-4bb7-8618-41abe6a6eb6d tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5690501-df0b-4dc1-85a6-b02c13517d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f665042f-c288-4bb7-8618-41abe6a6eb6d tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5690501-df0b-4dc1-85a6-b02c13517d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34c8b1fe-4417-4843-8e7c-e5beff9bb3a0', 'volume_name': 'volume-34c8b1fe-4417-4843-8e7c-e5beff9bb3a0', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f665042f-c288-4bb7-8618-41abe6a6eb6d tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1cff313-25d2-4c40-bd84-3c4c04e995f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f665042f-c288-4bb7-8618-41abe6a6eb6d tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1cff313-25d2-4c40-bd84-3c4c04e995f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f665042f-c288-4bb7-8618-41abe6a6eb6d tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (863ca50f-71e0-4e3f-afde-32eba4375f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:45 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-f665042f-c288-4bb7-8618-41abe6a6eb6d tempest-CreateVolumesFromSnapshotTest-389980398 None] Volume 34c8b1fe-4417-4843-8e7c-e5beff9bb3a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34c8b1fe-4417-4843-8e7c-e5beff9bb3a0', 'volume_size': 1}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f665042f-c288-4bb7-8618-41abe6a6eb6d tempest-CreateVolumesFromSnapshotTest-389980398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:45 devstack sudo[89931]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9dcaa4dc-ab04-4e1e-aec0-a2db9f15e0b3 tempest-CreateVolumesFromImageTest-611315179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-89015713-18de-4d83-83b4-9ca26deda2b0" returned: 0 in 0.570s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9dcaa4dc-ab04-4e1e-aec0-a2db9f15e0b3 tempest-CreateVolumesFromImageTest-611315179 None] Lock "cinder-quobyte-89015713-18de-4d83-83b4-9ca26deda2b0" released by "delete_volume" :: held 1.176s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-9dcaa4dc-ab04-4e1e-aec0-a2db9f15e0b3 tempest-CreateVolumesFromImageTest-611315179 None] Created reservations ['267b2675-d1cd-4270-8de2-6d139867688a', 'ebe3f9ee-5845-4052-a9ea-153a77f33e42', 'e88a0278-4997-4f69-a615-27603a14c590', 'e477bf7a-0466-4f67-a3b7-ff6811a6db8a'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-9dcaa4dc-ab04-4e1e-aec0-a2db9f15e0b3 tempest-CreateVolumesFromImageTest-611315179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-9dcaa4dc-ab04-4e1e-aec0-a2db9f15e0b3 tempest-CreateVolumesFromImageTest-611315179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-9dcaa4dc-ab04-4e1e-aec0-a2db9f15e0b3 tempest-CreateVolumesFromImageTest-611315179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-9dcaa4dc-ab04-4e1e-aec0-a2db9f15e0b3 tempest-CreateVolumesFromImageTest-611315179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-9dcaa4dc-ab04-4e1e-aec0-a2db9f15e0b3 tempest-CreateVolumesFromImageTest-611315179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9dcaa4dc-ab04-4e1e-aec0-a2db9f15e0b3 tempest-CreateVolumesFromImageTest-611315179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-40680149-7421-4522-8f45-f57563f4d26a tempest-CreateVolumesFromSnapshotTest-389980398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:34:45 devstack sudo[89942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:34:45 devstack sudo[89942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-40680149-7421-4522-8f45-f57563f4d26a tempest-CreateVolumesFromSnapshotTest-389980398 None] Flow 'volume_create_manager' (392a4a92-acb9-4ad5-a263-fa7d8521f407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:34:45 devstack sudo[89936]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-40680149-7421-4522-8f45-f57563f4d26a tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6f66998-0686-4519-aa23-221d4d11d832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-842d73bd-cca3-41a2-baf4-757dc94913df tempest-VolumeDependencyTests-1466340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4.d31db937-6e4c-456b-8967-94d7f696268c" returned: 0 in 0.541s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:45 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-842d73bd-cca3-41a2-baf4-757dc94913df tempest-VolumeDependencyTests-1466340 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4.d31db937-6e4c-456b-8967-94d7f696268c is being set with open permissions: ugo+rw
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-842d73bd-cca3-41a2-baf4-757dc94913df tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4.d31db937-6e4c-456b-8967-94d7f696268c {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-40680149-7421-4522-8f45-f57563f4d26a tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6f66998-0686-4519-aa23-221d4d11d832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1480243788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8dbdc3a-f2b6-4c9b-a5b9-1a30a2a93607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3ec0d897f864fd48c73c167d0e04a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:46Z,use_quota=True,user_id='3704a8c936c648b8acf521c70085dff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-40680149-7421-4522-8f45-f57563f4d26a tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d9d70fb-dd0b-49c7-9758-d424ff70683b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-40680149-7421-4522-8f45-f57563f4d26a tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d9d70fb-dd0b-49c7-9758-d424ff70683b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-40680149-7421-4522-8f45-f57563f4d26a tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (195baafc-d2a5-4b6b-9a10-580052d83adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-40680149-7421-4522-8f45-f57563f4d26a tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (195baafc-d2a5-4b6b-9a10-580052d83adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8dbdc3a-f2b6-4c9b-a5b9-1a30a2a93607', 'volume_name': 'volume-a8dbdc3a-f2b6-4c9b-a5b9-1a30a2a93607', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-40680149-7421-4522-8f45-f57563f4d26a tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fbc274d-cff6-46a4-929d-3d2a1731c8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-40680149-7421-4522-8f45-f57563f4d26a tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fbc274d-cff6-46a4-929d-3d2a1731c8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:45 devstack sudo[89944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4.d31db937-6e4c-456b-8967-94d7f696268c
Apr 02 10:34:45 devstack sudo[89944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-40680149-7421-4522-8f45-f57563f4d26a tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b8c85d2-264e-402c-a396-554beafb4774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:45 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-40680149-7421-4522-8f45-f57563f4d26a tempest-CreateVolumesFromSnapshotTest-389980398 None] Volume a8dbdc3a-f2b6-4c9b-a5b9-1a30a2a93607: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8dbdc3a-f2b6-4c9b-a5b9-1a30a2a93607', 'volume_size': 1}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-40680149-7421-4522-8f45-f57563f4d26a tempest-CreateVolumesFromSnapshotTest-389980398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce57fa64-7e5a-4d8e-b803-c9b7881ef473 tempest-CreateVolumesFromSnapshotTest-389980398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ce57fa64-7e5a-4d8e-b803-c9b7881ef473 tempest-CreateVolumesFromSnapshotTest-389980398 None] Flow 'volume_create_manager' (dcb8af8b-371a-40f7-8bde-72101df2df70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ce57fa64-7e5a-4d8e-b803-c9b7881ef473 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae0f8e8c-6741-49b3-8fad-3ac9e9215604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ce57fa64-7e5a-4d8e-b803-c9b7881ef473 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae0f8e8c-6741-49b3-8fad-3ac9e9215604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1523320765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=098058c5-6adb-4ce4-b94b-5ca61c821cd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3ec0d897f864fd48c73c167d0e04a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:46Z,use_quota=True,user_id='3704a8c936c648b8acf521c70085dff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ce57fa64-7e5a-4d8e-b803-c9b7881ef473 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa473510-5091-4da2-8794-e7286638f6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ce57fa64-7e5a-4d8e-b803-c9b7881ef473 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa473510-5091-4da2-8794-e7286638f6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ce57fa64-7e5a-4d8e-b803-c9b7881ef473 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59387ac9-9227-4b38-b9fd-f156920be3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ce57fa64-7e5a-4d8e-b803-c9b7881ef473 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59387ac9-9227-4b38-b9fd-f156920be3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '098058c5-6adb-4ce4-b94b-5ca61c821cd2', 'volume_name': 'volume-098058c5-6adb-4ce4-b94b-5ca61c821cd2', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ce57fa64-7e5a-4d8e-b803-c9b7881ef473 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29612702-d668-4bc3-ab01-aed4f831a5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ce57fa64-7e5a-4d8e-b803-c9b7881ef473 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29612702-d668-4bc3-ab01-aed4f831a5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ce57fa64-7e5a-4d8e-b803-c9b7881ef473 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e430cff2-f620-4a5a-91c4-05e33afa55e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:45 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-ce57fa64-7e5a-4d8e-b803-c9b7881ef473 tempest-CreateVolumesFromSnapshotTest-389980398 None] Volume 098058c5-6adb-4ce4-b94b-5ca61c821cd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-098058c5-6adb-4ce4-b94b-5ca61c821cd2', 'volume_size': 1}
Apr 02 10:34:45 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ce57fa64-7e5a-4d8e-b803-c9b7881ef473 tempest-CreateVolumesFromSnapshotTest-389980398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:46 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed4aa46e-6325-437d-9bdc-7572f7468287 tempest-CreateVolumesFromSnapshotTest-389980398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:34:46 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ed4aa46e-6325-437d-9bdc-7572f7468287 tempest-CreateVolumesFromSnapshotTest-389980398 None] Flow 'volume_create_manager' (c096f5ab-73b3-40ed-b8f9-b03cbd4bd900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:34:46 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ed4aa46e-6325-437d-9bdc-7572f7468287 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f86075-fdfa-432d-9170-3eb0a6177778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:46 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ed4aa46e-6325-437d-9bdc-7572f7468287 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f86075-fdfa-432d-9170-3eb0a6177778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1864262954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00afe3f0-3f1a-4abd-bc18-3fe771c763d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3ec0d897f864fd48c73c167d0e04a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:46Z,use_quota=True,user_id='3704a8c936c648b8acf521c70085dff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:46 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ed4aa46e-6325-437d-9bdc-7572f7468287 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4e2679-2721-4a99-8c6c-982fe83e8232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:46 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ed4aa46e-6325-437d-9bdc-7572f7468287 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4e2679-2721-4a99-8c6c-982fe83e8232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:46 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ed4aa46e-6325-437d-9bdc-7572f7468287 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ec1aba-21c6-46f5-ace5-cfe9e6356ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:46 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ed4aa46e-6325-437d-9bdc-7572f7468287 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ec1aba-21c6-46f5-ace5-cfe9e6356ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00afe3f0-3f1a-4abd-bc18-3fe771c763d0', 'volume_name': 'volume-00afe3f0-3f1a-4abd-bc18-3fe771c763d0', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:46 devstack sudo[89942]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:46 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ed4aa46e-6325-437d-9bdc-7572f7468287 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5044dbac-9156-4c15-ad45-19e5b2b0bc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:46 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ed4aa46e-6325-437d-9bdc-7572f7468287 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5044dbac-9156-4c15-ad45-19e5b2b0bc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:46 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ed4aa46e-6325-437d-9bdc-7572f7468287 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (741e99ea-b347-4ac3-a6ef-da62a6856b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:46 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-ed4aa46e-6325-437d-9bdc-7572f7468287 tempest-CreateVolumesFromSnapshotTest-389980398 None] Volume 00afe3f0-3f1a-4abd-bc18-3fe771c763d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00afe3f0-3f1a-4abd-bc18-3fe771c763d0', 'volume_size': 1}
Apr 02 10:34:46 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ed4aa46e-6325-437d-9bdc-7572f7468287 tempest-CreateVolumesFromSnapshotTest-389980398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:46 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9dcaa4dc-ab04-4e1e-aec0-a2db9f15e0b3 tempest-CreateVolumesFromImageTest-611315179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.690s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:46 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-9dcaa4dc-ab04-4e1e-aec0-a2db9f15e0b3 tempest-CreateVolumesFromImageTest-611315179 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:34:46 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-9dcaa4dc-ab04-4e1e-aec0-a2db9f15e0b3 tempest-CreateVolumesFromImageTest-611315179 None] Deleted volume successfully.
Apr 02 10:34:46 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9dcaa4dc-ab04-4e1e-aec0-a2db9f15e0b3 tempest-CreateVolumesFromImageTest-611315179 None] Lock "cinder-89015713-18de-4d83-83b4-9ca26deda2b0-delete_volume" released by "delete_volume" :: held 2.070s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:34:46 devstack sudo[89944]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:46 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-842d73bd-cca3-41a2-baf4-757dc94913df tempest-VolumeDependencyTests-1466340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4.d31db937-6e4c-456b-8967-94d7f696268c" returned: 0 in 0.716s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:46 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-842d73bd-cca3-41a2-baf4-757dc94913df tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:46 devstack sudo[89948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4.info
Apr 02 10:34:46 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:46 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-e60bdbe0-5dff-434a-95b1-115515588c54 tempest-CreateVolumesFromImageTest-611315179 None] Acquiring lock "cinder-cad04373-9703-4547-be5f-56e32dd65caa-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:46 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-e60bdbe0-5dff-434a-95b1-115515588c54 tempest-CreateVolumesFromImageTest-611315179 None] Lock "cinder-cad04373-9703-4547-be5f-56e32dd65caa-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:46 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-e60bdbe0-5dff-434a-95b1-115515588c54 tempest-CreateVolumesFromImageTest-611315179 None] Acquiring lock "cinder-quobyte-cad04373-9703-4547-be5f-56e32dd65caa" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:46 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-e60bdbe0-5dff-434a-95b1-115515588c54 tempest-CreateVolumesFromImageTest-611315179 None] Lock "cinder-quobyte-cad04373-9703-4547-be5f-56e32dd65caa" acquired by "delete_volume" :: waited 0.011s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:46 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea06b87-f8b0-4133-9e38-c55d65c309a9]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:34:46 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e60bdbe0-5dff-434a-95b1-115515588c54 tempest-CreateVolumesFromImageTest-611315179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-cad04373-9703-4547-be5f-56e32dd65caa {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:46 devstack sudo[89950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-cad04373-9703-4547-be5f-56e32dd65caa
Apr 02 10:34:46 devstack sudo[89950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:46 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:46 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-842d73bd-cca3-41a2-baf4-757dc94913df tempest-VolumeDependencyTests-1466340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4.info" returned: 0 in 0.544s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:46 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-842d73bd-cca3-41a2-baf4-757dc94913df tempest-VolumeDependencyTests-1466340 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4.info is being set with open permissions: ugo+rw
Apr 02 10:34:46 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-842d73bd-cca3-41a2-baf4-757dc94913df tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:46 devstack sudo[89953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4.info
Apr 02 10:34:46 devstack sudo[89953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:47 devstack sudo[89950]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e60bdbe0-5dff-434a-95b1-115515588c54 tempest-CreateVolumesFromImageTest-611315179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-cad04373-9703-4547-be5f-56e32dd65caa" returned: 0 in 0.571s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e60bdbe0-5dff-434a-95b1-115515588c54 tempest-CreateVolumesFromImageTest-611315179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-cad04373-9703-4547-be5f-56e32dd65caa {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:47 devstack sudo[89958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-cad04373-9703-4547-be5f-56e32dd65caa
Apr 02 10:34:47 devstack sudo[89958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:47 devstack sudo[89953]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-842d73bd-cca3-41a2-baf4-757dc94913df tempest-VolumeDependencyTests-1466340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4.info" returned: 0 in 0.471s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-842d73bd-cca3-41a2-baf4-757dc94913df tempest-VolumeDependencyTests-1466340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.472s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ac415b30-ac99-421d-a02e-bc034199d4b8 tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.327s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:47 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-ac415b30-ac99-421d-a02e-bc034199d4b8 tempest-CreateVolumesFromSnapshotTest-389980398 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2051733126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aec8915-3aee-44a5-aa50-389469d46121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3ec0d897f864fd48c73c167d0e04a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:45Z,use_quota=True,user_id='3704a8c936c648b8acf521c70085dff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:34:47 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-ac415b30-ac99-421d-a02e-bc034199d4b8 tempest-CreateVolumesFromSnapshotTest-389980398 None] Creating volume 8aec8915-3aee-44a5-aa50-389469d46121 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:34:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ac415b30-ac99-421d-a02e-bc034199d4b8 tempest-CreateVolumesFromSnapshotTest-389980398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ac415b30-ac99-421d-a02e-bc034199d4b8 tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:47 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-ac415b30-ac99-421d-a02e-bc034199d4b8 tempest-CreateVolumesFromSnapshotTest-389980398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:34:47 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-ac415b30-ac99-421d-a02e-bc034199d4b8 tempest-CreateVolumesFromSnapshotTest-389980398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:34:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ac415b30-ac99-421d-a02e-bc034199d4b8 tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:47 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-ac415b30-ac99-421d-a02e-bc034199d4b8 tempest-CreateVolumesFromSnapshotTest-389980398 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:34:47 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-ac415b30-ac99-421d-a02e-bc034199d4b8 tempest-CreateVolumesFromSnapshotTest-389980398 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:34:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ac415b30-ac99-421d-a02e-bc034199d4b8 tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8aec8915-3aee-44a5-aa50-389469d46121 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:47 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-842d73bd-cca3-41a2-baf4-757dc94913df tempest-VolumeDependencyTests-1466340 None] Create snapshot completed successfully
Apr 02 10:34:47 devstack sudo[89961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8aec8915-3aee-44a5-aa50-389469d46121 1073741824
Apr 02 10:34:47 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:47 devstack sudo[89958]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e60bdbe0-5dff-434a-95b1-115515588c54 tempest-CreateVolumesFromImageTest-611315179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-cad04373-9703-4547-be5f-56e32dd65caa" returned: 0 in 0.670s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:47 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-e60bdbe0-5dff-434a-95b1-115515588c54 tempest-CreateVolumesFromImageTest-611315179 None] Lock "cinder-quobyte-cad04373-9703-4547-be5f-56e32dd65caa" released by "delete_volume" :: held 1.262s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:34:47 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-e60bdbe0-5dff-434a-95b1-115515588c54 tempest-CreateVolumesFromImageTest-611315179 None] Created reservations ['31921d2f-13ef-4979-9178-18d2fdb5ba2f', 'b4465ddc-e7d0-4f35-ad1d-ce58251fbd58', '956d6609-60c0-49c6-b349-409fff7baa4f', '03ec2f95-1740-45e1-8fda-8a2e56fb2aa6'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:34:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e60bdbe0-5dff-434a-95b1-115515588c54 tempest-CreateVolumesFromImageTest-611315179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e60bdbe0-5dff-434a-95b1-115515588c54 tempest-CreateVolumesFromImageTest-611315179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:47 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e60bdbe0-5dff-434a-95b1-115515588c54 tempest-CreateVolumesFromImageTest-611315179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:34:47 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e60bdbe0-5dff-434a-95b1-115515588c54 tempest-CreateVolumesFromImageTest-611315179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:34:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e60bdbe0-5dff-434a-95b1-115515588c54 tempest-CreateVolumesFromImageTest-611315179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:47 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e60bdbe0-5dff-434a-95b1-115515588c54 tempest-CreateVolumesFromImageTest-611315179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:47 devstack sudo[89964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:34:47 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:48 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e60bdbe0-5dff-434a-95b1-115515588c54 tempest-CreateVolumesFromImageTest-611315179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.515s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:48 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-e60bdbe0-5dff-434a-95b1-115515588c54 tempest-CreateVolumesFromImageTest-611315179 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:34:48 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-e60bdbe0-5dff-434a-95b1-115515588c54 tempest-CreateVolumesFromImageTest-611315179 None] Deleted volume successfully.
Apr 02 10:34:48 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-e60bdbe0-5dff-434a-95b1-115515588c54 tempest-CreateVolumesFromImageTest-611315179 None] Lock "cinder-cad04373-9703-4547-be5f-56e32dd65caa-delete_volume" released by "delete_volume" :: held 1.933s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:34:48 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ac415b30-ac99-421d-a02e-bc034199d4b8 tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8aec8915-3aee-44a5-aa50-389469d46121 1073741824" returned: 0 in 0.944s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:48 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:34:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ac415b30-ac99-421d-a02e-bc034199d4b8 tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8aec8915-3aee-44a5-aa50-389469d46121 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:48 devstack sudo[89970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8aec8915-3aee-44a5-aa50-389469d46121
Apr 02 10:34:48 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Flow 'volume_create_manager' (583b1a9a-6b63-46e7-96b0-73b8811be422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:34:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d3b389a-caba-45ef-b688-600d7888067f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d3b389a-caba-45ef-b688-600d7888067f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-878119693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8367d611-3cbd-49eb-82b4-b95dfd2607f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e1353b5f6e343c0896535424f8300ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d31db937-6e4c-456b-8967-94d7f696268c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:48Z,use_quota=True,user_id='afea7cd197ef4f3c9f4a091988c19f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c4305d3-6622-42d5-a266-95537dbdf906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c4305d3-6622-42d5-a266-95537dbdf906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ebe8ba4-b2fe-42d9-ba35-3817181a62e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ebe8ba4-b2fe-42d9-ba35-3817181a62e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8367d611-3cbd-49eb-82b4-b95dfd2607f3', 'volume_name': 'volume-8367d611-3cbd-49eb-82b4-b95dfd2607f3', 'volume_size': 1, 'snapshot_id': 'd31db937-6e4c-456b-8967-94d7f696268c'}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7d90c9b-3990-40e7-a3f6-d170e4794e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7d90c9b-3990-40e7-a3f6-d170e4794e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:48 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baeced67-cea8-4a90-b779-fe4cf31b2749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:48 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Volume 8367d611-3cbd-49eb-82b4-b95dfd2607f3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8367d611-3cbd-49eb-82b4-b95dfd2607f3', 'volume_size': 1, 'snapshot_id': 'd31db937-6e4c-456b-8967-94d7f696268c'}
Apr 02 10:34:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:48 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2e497e63-36b6-4920-b059-f25be30d247a tempest-CreateVolumesFromImageTest-611315179 None] Acquiring lock "cinder-06b040d6-e6b5-4212-8c4e-a1d268ca679a-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:48 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2e497e63-36b6-4920-b059-f25be30d247a tempest-CreateVolumesFromImageTest-611315179 None] Lock "cinder-06b040d6-e6b5-4212-8c4e-a1d268ca679a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:48 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2e497e63-36b6-4920-b059-f25be30d247a tempest-CreateVolumesFromImageTest-611315179 None] Acquiring lock "cinder-quobyte-06b040d6-e6b5-4212-8c4e-a1d268ca679a" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:48 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2e497e63-36b6-4920-b059-f25be30d247a tempest-CreateVolumesFromImageTest-611315179 None] Lock "cinder-quobyte-06b040d6-e6b5-4212-8c4e-a1d268ca679a" acquired by "delete_volume" :: waited 0.041s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:48 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb32446-f98a-4f60-90d9-929e7b0502c5]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:34:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2e497e63-36b6-4920-b059-f25be30d247a tempest-CreateVolumesFromImageTest-611315179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-06b040d6-e6b5-4212-8c4e-a1d268ca679a {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:48 devstack sudo[90006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-06b040d6-e6b5-4212-8c4e-a1d268ca679a
Apr 02 10:34:48 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:48 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ac415b30-ac99-421d-a02e-bc034199d4b8 tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8aec8915-3aee-44a5-aa50-389469d46121" returned: 0 in 0.561s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:48 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-ac415b30-ac99-421d-a02e-bc034199d4b8 tempest-CreateVolumesFromSnapshotTest-389980398 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:34:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ac415b30-ac99-421d-a02e-bc034199d4b8 tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f665042f-c288-4bb7-8618-41abe6a6eb6d tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.648s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:48 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f665042f-c288-4bb7-8618-41abe6a6eb6d tempest-CreateVolumesFromSnapshotTest-389980398 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-186393557',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34c8b1fe-4417-4843-8e7c-e5beff9bb3a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3ec0d897f864fd48c73c167d0e04a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:45Z,use_quota=True,user_id='3704a8c936c648b8acf521c70085dff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:34:48 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-f665042f-c288-4bb7-8618-41abe6a6eb6d tempest-CreateVolumesFromSnapshotTest-389980398 None] Creating volume 34c8b1fe-4417-4843-8e7c-e5beff9bb3a0 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:34:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f665042f-c288-4bb7-8618-41abe6a6eb6d tempest-CreateVolumesFromSnapshotTest-389980398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f665042f-c288-4bb7-8618-41abe6a6eb6d tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:48 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f665042f-c288-4bb7-8618-41abe6a6eb6d tempest-CreateVolumesFromSnapshotTest-389980398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:34:48 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f665042f-c288-4bb7-8618-41abe6a6eb6d tempest-CreateVolumesFromSnapshotTest-389980398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:34:48 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f665042f-c288-4bb7-8618-41abe6a6eb6d tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:48 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f665042f-c288-4bb7-8618-41abe6a6eb6d tempest-CreateVolumesFromSnapshotTest-389980398 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:34:48 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-f665042f-c288-4bb7-8618-41abe6a6eb6d tempest-CreateVolumesFromSnapshotTest-389980398 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:34:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f665042f-c288-4bb7-8618-41abe6a6eb6d tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34c8b1fe-4417-4843-8e7c-e5beff9bb3a0 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:49 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ac415b30-ac99-421d-a02e-bc034199d4b8 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f58824c-0d79-4cfb-b985-c8389ed37cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8aec8915-3aee-44a5-aa50-389469d46121', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:49 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ac415b30-ac99-421d-a02e-bc034199d4b8 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f21c17d-1ca2-4079-a2ea-b60ae83578ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:49 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-ac415b30-ac99-421d-a02e-bc034199d4b8 tempest-CreateVolumesFromSnapshotTest-389980398 None] Volume volume-8aec8915-3aee-44a5-aa50-389469d46121 (8aec8915-3aee-44a5-aa50-389469d46121): created successfully
Apr 02 10:34:49 devstack sudo[90009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34c8b1fe-4417-4843-8e7c-e5beff9bb3a0 1073741824
Apr 02 10:34:49 devstack sudo[90009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:49 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ac415b30-ac99-421d-a02e-bc034199d4b8 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f21c17d-1ca2-4079-a2ea-b60ae83578ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:49 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ac415b30-ac99-421d-a02e-bc034199d4b8 tempest-CreateVolumesFromSnapshotTest-389980398 None] Flow 'volume_create_manager' (d6ebfba2-2ca6-4a27-9fdd-bf820e9dd842) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:34:49 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-ac415b30-ac99-421d-a02e-bc034199d4b8 tempest-CreateVolumesFromSnapshotTest-389980398 None] Created volume successfully.
Apr 02 10:34:49 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2e497e63-36b6-4920-b059-f25be30d247a tempest-CreateVolumesFromImageTest-611315179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-06b040d6-e6b5-4212-8c4e-a1d268ca679a" returned: 0 in 0.591s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2e497e63-36b6-4920-b059-f25be30d247a tempest-CreateVolumesFromImageTest-611315179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-06b040d6-e6b5-4212-8c4e-a1d268ca679a {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:49 devstack sudo[90014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-06b040d6-e6b5-4212-8c4e-a1d268ca679a
Apr 02 10:34:49 devstack sudo[90014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:49 devstack sudo[90009]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f665042f-c288-4bb7-8618-41abe6a6eb6d tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34c8b1fe-4417-4843-8e7c-e5beff9bb3a0 1073741824" returned: 0 in 0.673s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f665042f-c288-4bb7-8618-41abe6a6eb6d tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34c8b1fe-4417-4843-8e7c-e5beff9bb3a0 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:49 devstack sudo[90019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34c8b1fe-4417-4843-8e7c-e5beff9bb3a0
Apr 02 10:34:49 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:49 devstack sudo[90014]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:49 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2e497e63-36b6-4920-b059-f25be30d247a tempest-CreateVolumesFromImageTest-611315179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-06b040d6-e6b5-4212-8c4e-a1d268ca679a" returned: 0 in 0.500s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:49 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2e497e63-36b6-4920-b059-f25be30d247a tempest-CreateVolumesFromImageTest-611315179 None] Lock "cinder-quobyte-06b040d6-e6b5-4212-8c4e-a1d268ca679a" released by "delete_volume" :: held 1.120s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:34:49 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-2e497e63-36b6-4920-b059-f25be30d247a tempest-CreateVolumesFromImageTest-611315179 None] Created reservations ['006bffc2-2146-4621-ae06-cd061248485e', '5292f5dc-73db-40e4-983a-5ef0e3034224', '1784ea25-feee-470a-aafb-4fc61f8bc54e', '0b0bbab7-68d6-436a-8b36-46b152368729'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:34:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-2e497e63-36b6-4920-b059-f25be30d247a tempest-CreateVolumesFromImageTest-611315179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-2e497e63-36b6-4920-b059-f25be30d247a tempest-CreateVolumesFromImageTest-611315179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:50 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-2e497e63-36b6-4920-b059-f25be30d247a tempest-CreateVolumesFromImageTest-611315179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:34:50 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-2e497e63-36b6-4920-b059-f25be30d247a tempest-CreateVolumesFromImageTest-611315179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:34:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-2e497e63-36b6-4920-b059-f25be30d247a tempest-CreateVolumesFromImageTest-611315179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2e497e63-36b6-4920-b059-f25be30d247a tempest-CreateVolumesFromImageTest-611315179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:50 devstack sudo[90022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:34:50 devstack sudo[90022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:50 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f665042f-c288-4bb7-8618-41abe6a6eb6d tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34c8b1fe-4417-4843-8e7c-e5beff9bb3a0" returned: 0 in 0.499s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:50 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f665042f-c288-4bb7-8618-41abe6a6eb6d tempest-CreateVolumesFromSnapshotTest-389980398 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:34:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f665042f-c288-4bb7-8618-41abe6a6eb6d tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-40680149-7421-4522-8f45-f57563f4d26a tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.468s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:50 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-40680149-7421-4522-8f45-f57563f4d26a tempest-CreateVolumesFromSnapshotTest-389980398 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1480243788',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8dbdc3a-f2b6-4c9b-a5b9-1a30a2a93607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3ec0d897f864fd48c73c167d0e04a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:46Z,use_quota=True,user_id='3704a8c936c648b8acf521c70085dff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:34:50 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-40680149-7421-4522-8f45-f57563f4d26a tempest-CreateVolumesFromSnapshotTest-389980398 None] Creating volume a8dbdc3a-f2b6-4c9b-a5b9-1a30a2a93607 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:34:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-40680149-7421-4522-8f45-f57563f4d26a tempest-CreateVolumesFromSnapshotTest-389980398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-40680149-7421-4522-8f45-f57563f4d26a tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:50 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-40680149-7421-4522-8f45-f57563f4d26a tempest-CreateVolumesFromSnapshotTest-389980398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:34:50 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-40680149-7421-4522-8f45-f57563f4d26a tempest-CreateVolumesFromSnapshotTest-389980398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:34:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-40680149-7421-4522-8f45-f57563f4d26a tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:50 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-40680149-7421-4522-8f45-f57563f4d26a tempest-CreateVolumesFromSnapshotTest-389980398 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:34:50 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-40680149-7421-4522-8f45-f57563f4d26a tempest-CreateVolumesFromSnapshotTest-389980398 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:34:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-40680149-7421-4522-8f45-f57563f4d26a tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8dbdc3a-f2b6-4c9b-a5b9-1a30a2a93607 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f665042f-c288-4bb7-8618-41abe6a6eb6d tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (863ca50f-71e0-4e3f-afde-32eba4375f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34c8b1fe-4417-4843-8e7c-e5beff9bb3a0', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f665042f-c288-4bb7-8618-41abe6a6eb6d tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57a17939-b38c-4d6d-a70a-e4a2d642052a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:50 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-f665042f-c288-4bb7-8618-41abe6a6eb6d tempest-CreateVolumesFromSnapshotTest-389980398 None] Volume volume-34c8b1fe-4417-4843-8e7c-e5beff9bb3a0 (34c8b1fe-4417-4843-8e7c-e5beff9bb3a0): created successfully
Apr 02 10:34:50 devstack sudo[90025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8dbdc3a-f2b6-4c9b-a5b9-1a30a2a93607 1073741824
Apr 02 10:34:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f665042f-c288-4bb7-8618-41abe6a6eb6d tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57a17939-b38c-4d6d-a70a-e4a2d642052a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:50 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:50 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-f665042f-c288-4bb7-8618-41abe6a6eb6d tempest-CreateVolumesFromSnapshotTest-389980398 None] Flow 'volume_create_manager' (79a6cc59-ee83-462a-926b-ec12c01c292d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:34:50 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-f665042f-c288-4bb7-8618-41abe6a6eb6d tempest-CreateVolumesFromSnapshotTest-389980398 None] Created volume successfully.
Apr 02 10:34:50 devstack sudo[90022]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2e497e63-36b6-4920-b059-f25be30d247a tempest-CreateVolumesFromImageTest-611315179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.526s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:50 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-2e497e63-36b6-4920-b059-f25be30d247a tempest-CreateVolumesFromImageTest-611315179 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:34:50 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-2e497e63-36b6-4920-b059-f25be30d247a tempest-CreateVolumesFromImageTest-611315179 None] Deleted volume successfully.
Apr 02 10:34:50 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2e497e63-36b6-4920-b059-f25be30d247a tempest-CreateVolumesFromImageTest-611315179 None] Lock "cinder-06b040d6-e6b5-4212-8c4e-a1d268ca679a-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:34:50 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-40680149-7421-4522-8f45-f57563f4d26a tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8dbdc3a-f2b6-4c9b-a5b9-1a30a2a93607 1073741824" returned: 0 in 0.616s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:50 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-40680149-7421-4522-8f45-f57563f4d26a tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8dbdc3a-f2b6-4c9b-a5b9-1a30a2a93607 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:50 devstack sudo[90031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8dbdc3a-f2b6-4c9b-a5b9-1a30a2a93607
Apr 02 10:34:50 devstack sudo[90031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:50 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f479d1cd-f143-45e1-9ae3-1e31208040eb tempest-CreateVolumesFromImageTest-611315179 None] Acquiring lock "cinder-0c8e43f1-4362-43c8-9de9-2995edcf9bb1-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:50 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f479d1cd-f143-45e1-9ae3-1e31208040eb tempest-CreateVolumesFromImageTest-611315179 None] Lock "cinder-0c8e43f1-4362-43c8-9de9-2995edcf9bb1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f479d1cd-f143-45e1-9ae3-1e31208040eb tempest-CreateVolumesFromImageTest-611315179 None] Acquiring lock "cinder-quobyte-0c8e43f1-4362-43c8-9de9-2995edcf9bb1" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f479d1cd-f143-45e1-9ae3-1e31208040eb tempest-CreateVolumesFromImageTest-611315179 None] Lock "cinder-quobyte-0c8e43f1-4362-43c8-9de9-2995edcf9bb1" acquired by "delete_volume" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b873db-86da-45b5-b645-cd6e34db9996]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f479d1cd-f143-45e1-9ae3-1e31208040eb tempest-CreateVolumesFromImageTest-611315179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-0c8e43f1-4362-43c8-9de9-2995edcf9bb1 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:51 devstack sudo[90034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-0c8e43f1-4362-43c8-9de9-2995edcf9bb1
Apr 02 10:34:51 devstack sudo[90034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-d49ec41b-c656-4726-91d4-dbb46f7ec4f4 tempest-SnapshotDependencyTests-1378294697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d49ec41b-c656-4726-91d4-dbb46f7ec4f4 tempest-SnapshotDependencyTests-1378294697 None] Flow 'volume_create_manager' (58dfc955-45ec-4e01-b42e-8331063a57ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d49ec41b-c656-4726-91d4-dbb46f7ec4f4 tempest-SnapshotDependencyTests-1378294697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (417a0bee-c4a2-427d-a920-d3ce37e60dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d49ec41b-c656-4726-91d4-dbb46f7ec4f4 tempest-SnapshotDependencyTests-1378294697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (417a0bee-c4a2-427d-a920-d3ce37e60dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1624821464',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3219e7c-4a2a-4201-b860-13d416841808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ce0288e3a504e1184f345b0f2c613d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:51Z,use_quota=True,user_id='6a217c4bec2f455b87f5bbaef1061824',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d49ec41b-c656-4726-91d4-dbb46f7ec4f4 tempest-SnapshotDependencyTests-1378294697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02aa4048-6099-4eb6-a9f8-6be428af8708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:51 devstack sudo[90031]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d49ec41b-c656-4726-91d4-dbb46f7ec4f4 tempest-SnapshotDependencyTests-1378294697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02aa4048-6099-4eb6-a9f8-6be428af8708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d49ec41b-c656-4726-91d4-dbb46f7ec4f4 tempest-SnapshotDependencyTests-1378294697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c6eac41-0f38-4934-abf3-2eddf7a2834e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d49ec41b-c656-4726-91d4-dbb46f7ec4f4 tempest-SnapshotDependencyTests-1378294697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c6eac41-0f38-4934-abf3-2eddf7a2834e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3219e7c-4a2a-4201-b860-13d416841808', 'volume_name': 'volume-e3219e7c-4a2a-4201-b860-13d416841808', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d49ec41b-c656-4726-91d4-dbb46f7ec4f4 tempest-SnapshotDependencyTests-1378294697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f93b953c-0072-4539-ada1-9ea0b1172bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d49ec41b-c656-4726-91d4-dbb46f7ec4f4 tempest-SnapshotDependencyTests-1378294697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f93b953c-0072-4539-ada1-9ea0b1172bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d49ec41b-c656-4726-91d4-dbb46f7ec4f4 tempest-SnapshotDependencyTests-1378294697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b8fdec8-c278-4238-8c13-1f1ac307c1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:51 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-d49ec41b-c656-4726-91d4-dbb46f7ec4f4 tempest-SnapshotDependencyTests-1378294697 None] Volume e3219e7c-4a2a-4201-b860-13d416841808: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3219e7c-4a2a-4201-b860-13d416841808', 'volume_size': 1}
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d49ec41b-c656-4726-91d4-dbb46f7ec4f4 tempest-SnapshotDependencyTests-1378294697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-40680149-7421-4522-8f45-f57563f4d26a tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8dbdc3a-f2b6-4c9b-a5b9-1a30a2a93607" returned: 0 in 0.538s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-40680149-7421-4522-8f45-f57563f4d26a tempest-CreateVolumesFromSnapshotTest-389980398 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-40680149-7421-4522-8f45-f57563f4d26a tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ce57fa64-7e5a-4d8e-b803-c9b7881ef473 tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.500s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-ce57fa64-7e5a-4d8e-b803-c9b7881ef473 tempest-CreateVolumesFromSnapshotTest-389980398 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1523320765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=098058c5-6adb-4ce4-b94b-5ca61c821cd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3ec0d897f864fd48c73c167d0e04a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:46Z,use_quota=True,user_id='3704a8c936c648b8acf521c70085dff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-ce57fa64-7e5a-4d8e-b803-c9b7881ef473 tempest-CreateVolumesFromSnapshotTest-389980398 None] Creating volume 098058c5-6adb-4ce4-b94b-5ca61c821cd2 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ce57fa64-7e5a-4d8e-b803-c9b7881ef473 tempest-CreateVolumesFromSnapshotTest-389980398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ce57fa64-7e5a-4d8e-b803-c9b7881ef473 tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-ce57fa64-7e5a-4d8e-b803-c9b7881ef473 tempest-CreateVolumesFromSnapshotTest-389980398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-ce57fa64-7e5a-4d8e-b803-c9b7881ef473 tempest-CreateVolumesFromSnapshotTest-389980398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ce57fa64-7e5a-4d8e-b803-c9b7881ef473 tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-ce57fa64-7e5a-4d8e-b803-c9b7881ef473 tempest-CreateVolumesFromSnapshotTest-389980398 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:34:51 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-ce57fa64-7e5a-4d8e-b803-c9b7881ef473 tempest-CreateVolumesFromSnapshotTest-389980398 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ce57fa64-7e5a-4d8e-b803-c9b7881ef473 tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-098058c5-6adb-4ce4-b94b-5ca61c821cd2 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-40680149-7421-4522-8f45-f57563f4d26a tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b8c85d2-264e-402c-a396-554beafb4774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8dbdc3a-f2b6-4c9b-a5b9-1a30a2a93607', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:51 devstack sudo[90037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-098058c5-6adb-4ce4-b94b-5ca61c821cd2 1073741824
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-40680149-7421-4522-8f45-f57563f4d26a tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (749de696-2342-4f05-8386-4261ee24910c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:51 devstack sudo[90037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:51 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-40680149-7421-4522-8f45-f57563f4d26a tempest-CreateVolumesFromSnapshotTest-389980398 None] Volume volume-a8dbdc3a-f2b6-4c9b-a5b9-1a30a2a93607 (a8dbdc3a-f2b6-4c9b-a5b9-1a30a2a93607): created successfully
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-40680149-7421-4522-8f45-f57563f4d26a tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (749de696-2342-4f05-8386-4261ee24910c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-40680149-7421-4522-8f45-f57563f4d26a tempest-CreateVolumesFromSnapshotTest-389980398 None] Flow 'volume_create_manager' (392a4a92-acb9-4ad5-a263-fa7d8521f407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:34:51 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-40680149-7421-4522-8f45-f57563f4d26a tempest-CreateVolumesFromSnapshotTest-389980398 None] Created volume successfully.
Apr 02 10:34:51 devstack sudo[90034]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f479d1cd-f143-45e1-9ae3-1e31208040eb tempest-CreateVolumesFromImageTest-611315179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-0c8e43f1-4362-43c8-9de9-2995edcf9bb1" returned: 0 in 0.499s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f479d1cd-f143-45e1-9ae3-1e31208040eb tempest-CreateVolumesFromImageTest-611315179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-0c8e43f1-4362-43c8-9de9-2995edcf9bb1 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:51 devstack sudo[90042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-0c8e43f1-4362-43c8-9de9-2995edcf9bb1
Apr 02 10:34:51 devstack sudo[90042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:51 devstack sudo[90037]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ce57fa64-7e5a-4d8e-b803-c9b7881ef473 tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-098058c5-6adb-4ce4-b94b-5ca61c821cd2 1073741824" returned: 0 in 0.455s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ce57fa64-7e5a-4d8e-b803-c9b7881ef473 tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-098058c5-6adb-4ce4-b94b-5ca61c821cd2 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:51 devstack sudo[90048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-098058c5-6adb-4ce4-b94b-5ca61c821cd2
Apr 02 10:34:51 devstack sudo[90048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:51 devstack sudo[90042]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f479d1cd-f143-45e1-9ae3-1e31208040eb tempest-CreateVolumesFromImageTest-611315179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-0c8e43f1-4362-43c8-9de9-2995edcf9bb1" returned: 0 in 0.386s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f479d1cd-f143-45e1-9ae3-1e31208040eb tempest-CreateVolumesFromImageTest-611315179 None] Lock "cinder-quobyte-0c8e43f1-4362-43c8-9de9-2995edcf9bb1" released by "delete_volume" :: held 0.907s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:34:51 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-f479d1cd-f143-45e1-9ae3-1e31208040eb tempest-CreateVolumesFromImageTest-611315179 None] Created reservations ['5c17b249-fe10-440b-b8cb-643c1915ca29', 'd06f1fab-a690-45e7-af8a-d8bd9b4f5aaa', '68fde00a-68f1-4d0f-bc99-2d73adee99a9', '35fdb9ed-aeaf-4ff0-b5c5-481de208c4be'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:34:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f479d1cd-f143-45e1-9ae3-1e31208040eb tempest-CreateVolumesFromImageTest-611315179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f479d1cd-f143-45e1-9ae3-1e31208040eb tempest-CreateVolumesFromImageTest-611315179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:52 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f479d1cd-f143-45e1-9ae3-1e31208040eb tempest-CreateVolumesFromImageTest-611315179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:34:52 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-f479d1cd-f143-45e1-9ae3-1e31208040eb tempest-CreateVolumesFromImageTest-611315179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:34:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-f479d1cd-f143-45e1-9ae3-1e31208040eb tempest-CreateVolumesFromImageTest-611315179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f479d1cd-f143-45e1-9ae3-1e31208040eb tempest-CreateVolumesFromImageTest-611315179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:52 devstack sudo[90050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:34:52 devstack sudo[90050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:52 devstack sudo[90048]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ce57fa64-7e5a-4d8e-b803-c9b7881ef473 tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-098058c5-6adb-4ce4-b94b-5ca61c821cd2" returned: 0 in 0.404s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:52 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-ce57fa64-7e5a-4d8e-b803-c9b7881ef473 tempest-CreateVolumesFromSnapshotTest-389980398 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:34:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ce57fa64-7e5a-4d8e-b803-c9b7881ef473 tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ed4aa46e-6325-437d-9bdc-7572f7468287 tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.036s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:52 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-ed4aa46e-6325-437d-9bdc-7572f7468287 tempest-CreateVolumesFromSnapshotTest-389980398 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1864262954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00afe3f0-3f1a-4abd-bc18-3fe771c763d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3ec0d897f864fd48c73c167d0e04a33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:46Z,use_quota=True,user_id='3704a8c936c648b8acf521c70085dff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:34:52 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-ed4aa46e-6325-437d-9bdc-7572f7468287 tempest-CreateVolumesFromSnapshotTest-389980398 None] Creating volume 00afe3f0-3f1a-4abd-bc18-3fe771c763d0 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:34:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ed4aa46e-6325-437d-9bdc-7572f7468287 tempest-CreateVolumesFromSnapshotTest-389980398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ed4aa46e-6325-437d-9bdc-7572f7468287 tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:52 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-ed4aa46e-6325-437d-9bdc-7572f7468287 tempest-CreateVolumesFromSnapshotTest-389980398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:34:52 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-ed4aa46e-6325-437d-9bdc-7572f7468287 tempest-CreateVolumesFromSnapshotTest-389980398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:34:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ed4aa46e-6325-437d-9bdc-7572f7468287 tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:52 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-ed4aa46e-6325-437d-9bdc-7572f7468287 tempest-CreateVolumesFromSnapshotTest-389980398 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:34:52 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-ed4aa46e-6325-437d-9bdc-7572f7468287 tempest-CreateVolumesFromSnapshotTest-389980398 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:34:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ed4aa46e-6325-437d-9bdc-7572f7468287 tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-00afe3f0-3f1a-4abd-bc18-3fe771c763d0 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:52 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ce57fa64-7e5a-4d8e-b803-c9b7881ef473 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e430cff2-f620-4a5a-91c4-05e33afa55e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-098058c5-6adb-4ce4-b94b-5ca61c821cd2', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:52 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ce57fa64-7e5a-4d8e-b803-c9b7881ef473 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4590f86-5427-497e-b34a-a6150759d308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:52 devstack sudo[90053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-00afe3f0-3f1a-4abd-bc18-3fe771c763d0 1073741824
Apr 02 10:34:52 devstack sudo[90053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:52 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-ce57fa64-7e5a-4d8e-b803-c9b7881ef473 tempest-CreateVolumesFromSnapshotTest-389980398 None] Volume volume-098058c5-6adb-4ce4-b94b-5ca61c821cd2 (098058c5-6adb-4ce4-b94b-5ca61c821cd2): created successfully
Apr 02 10:34:52 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ce57fa64-7e5a-4d8e-b803-c9b7881ef473 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4590f86-5427-497e-b34a-a6150759d308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:52 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ce57fa64-7e5a-4d8e-b803-c9b7881ef473 tempest-CreateVolumesFromSnapshotTest-389980398 None] Flow 'volume_create_manager' (dcb8af8b-371a-40f7-8bde-72101df2df70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:34:52 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-ce57fa64-7e5a-4d8e-b803-c9b7881ef473 tempest-CreateVolumesFromSnapshotTest-389980398 None] Created volume successfully.
Apr 02 10:34:52 devstack sudo[90050]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-f479d1cd-f143-45e1-9ae3-1e31208040eb tempest-CreateVolumesFromImageTest-611315179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.458s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:52 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-f479d1cd-f143-45e1-9ae3-1e31208040eb tempest-CreateVolumesFromImageTest-611315179 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:34:52 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-f479d1cd-f143-45e1-9ae3-1e31208040eb tempest-CreateVolumesFromImageTest-611315179 None] Deleted volume successfully.
Apr 02 10:34:52 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-f479d1cd-f143-45e1-9ae3-1e31208040eb tempest-CreateVolumesFromImageTest-611315179 None] Lock "cinder-0c8e43f1-4362-43c8-9de9-2995edcf9bb1-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:34:52 devstack sudo[90053]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ed4aa46e-6325-437d-9bdc-7572f7468287 tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-00afe3f0-3f1a-4abd-bc18-3fe771c763d0 1073741824" returned: 0 in 0.560s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:52 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ed4aa46e-6325-437d-9bdc-7572f7468287 tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-00afe3f0-3f1a-4abd-bc18-3fe771c763d0 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:52 devstack sudo[90060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-00afe3f0-3f1a-4abd-bc18-3fe771c763d0
Apr 02 10:34:52 devstack sudo[90060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:53 devstack sudo[90060]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ed4aa46e-6325-437d-9bdc-7572f7468287 tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-00afe3f0-3f1a-4abd-bc18-3fe771c763d0" returned: 0 in 0.423s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-ed4aa46e-6325-437d-9bdc-7572f7468287 tempest-CreateVolumesFromSnapshotTest-389980398 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ed4aa46e-6325-437d-9bdc-7572f7468287 tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.788s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Acquiring lock "cinder-quobyte-d31db937-6e4c-456b-8967-94d7f696268c-8367d611-3cbd-49eb-82b4-b95dfd2607f3" by "_create_volume_from_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ed4aa46e-6325-437d-9bdc-7572f7468287 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (741e99ea-b347-4ac3-a6ef-da62a6856b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00afe3f0-3f1a-4abd-bc18-3fe771c763d0', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ed4aa46e-6325-437d-9bdc-7572f7468287 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (723eb6af-3abb-475f-822e-c967716ea1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:53 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-ed4aa46e-6325-437d-9bdc-7572f7468287 tempest-CreateVolumesFromSnapshotTest-389980398 None] Volume volume-00afe3f0-3f1a-4abd-bc18-3fe771c763d0 (00afe3f0-3f1a-4abd-bc18-3fe771c763d0): created successfully
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ed4aa46e-6325-437d-9bdc-7572f7468287 tempest-CreateVolumesFromSnapshotTest-389980398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (723eb6af-3abb-475f-822e-c967716ea1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-ed4aa46e-6325-437d-9bdc-7572f7468287 tempest-CreateVolumesFromSnapshotTest-389980398 None] Flow 'volume_create_manager' (c096f5ab-73b3-40ed-b8f9-b03cbd4bd900) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Lock "cinder-quobyte-d31db937-6e4c-456b-8967-94d7f696268c-8367d611-3cbd-49eb-82b4-b95dfd2607f3" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Creating volume 8367d611-3cbd-49eb-82b4-b95dfd2607f3 from snapshot d31db937-6e4c-456b-8967-94d7f696268c {{(pid=82102) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Acquiring lock "cinder-quobyte-8367d611-3cbd-49eb-82b4-b95dfd2607f3" by "_copy_volume_from_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:53 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-ed4aa46e-6325-437d-9bdc-7572f7468287 tempest-CreateVolumesFromSnapshotTest-389980398 None] Created volume successfully.
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Lock "cinder-quobyte-8367d611-3cbd-49eb-82b4-b95dfd2607f3" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] snapshot: d31db937-6e4c-456b-8967-94d7f696268c, volume: 8367d611-3cbd-49eb-82b4-b95dfd2607f3,  {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8f9ffb-62c2-496d-841d-f41fe0666289]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4.d31db937-6e4c-456b-8967-94d7f696268c {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:53 devstack sudo[90063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4.d31db937-6e4c-456b-8967-94d7f696268c
Apr 02 10:34:53 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1a23fe5e-f45e-4518-86af-1683d327ec12 tempest-CreateVolumesFromSnapshotTest-389980398 None] Acquiring lock "cinder-00afe3f0-3f1a-4abd-bc18-3fe771c763d0-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1a23fe5e-f45e-4518-86af-1683d327ec12 tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "cinder-00afe3f0-3f1a-4abd-bc18-3fe771c763d0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1a23fe5e-f45e-4518-86af-1683d327ec12 tempest-CreateVolumesFromSnapshotTest-389980398 None] Acquiring lock "cinder-quobyte-00afe3f0-3f1a-4abd-bc18-3fe771c763d0" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1a23fe5e-f45e-4518-86af-1683d327ec12 tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "cinder-quobyte-00afe3f0-3f1a-4abd-bc18-3fe771c763d0" acquired by "delete_volume" :: waited 0.013s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be463dd-6c83-4863-a00d-b3057956a8ea]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1a23fe5e-f45e-4518-86af-1683d327ec12 tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-00afe3f0-3f1a-4abd-bc18-3fe771c763d0 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:53 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4.d31db937-6e4c-456b-8967-94d7f696268c" returned: 0 in 0.592s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4 {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 02 10:34:53 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Creating direct copy from snapshot {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 02 10:34:54 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71eae50-3507-4831-ab21-88f971ddce25]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:34:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:54 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-8369fb08-11cc-4c48-97d6-679a1223d024 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:34:54 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8369fb08-11cc-4c48-97d6-679a1223d024 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Flow 'volume_create_manager' (2e60f5b6-5469-4867-b570-38a7637e41f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:34:54 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8369fb08-11cc-4c48-97d6-679a1223d024 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (244504f9-a9c1-4ff9-817c-0939a07f7eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:54 devstack sudo[90068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-00afe3f0-3f1a-4abd-bc18-3fe771c763d0
Apr 02 10:34:54 devstack sudo[90068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:54 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8369fb08-11cc-4c48-97d6-679a1223d024 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (244504f9-a9c1-4ff9-817c-0939a07f7eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-65741894',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43ae7732-5953-4573-b187-7ebe32f85977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248b8da63e634c2f8c52ada62001338d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:54Z,use_quota=True,user_id='ecb05c1834da450fa82b5fb1a058c81a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:54 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8369fb08-11cc-4c48-97d6-679a1223d024 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2df0ad9c-71bc-4620-bd4c-5fdce79d0ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:54 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8369fb08-11cc-4c48-97d6-679a1223d024 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2df0ad9c-71bc-4620-bd4c-5fdce79d0ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:54 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8369fb08-11cc-4c48-97d6-679a1223d024 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (709beb02-bd9c-4177-9b7f-317599a7bdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:54 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8369fb08-11cc-4c48-97d6-679a1223d024 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (709beb02-bd9c-4177-9b7f-317599a7bdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43ae7732-5953-4573-b187-7ebe32f85977', 'volume_name': 'volume-43ae7732-5953-4573-b187-7ebe32f85977', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:54 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8369fb08-11cc-4c48-97d6-679a1223d024 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7613b6f8-256e-4192-97c1-7cb6f6d872db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:54 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8369fb08-11cc-4c48-97d6-679a1223d024 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7613b6f8-256e-4192-97c1-7cb6f6d872db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:54 devstack sudo[90069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4
Apr 02 10:34:54 devstack sudo[90069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:54 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8369fb08-11cc-4c48-97d6-679a1223d024 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67347781-8439-4014-8d0e-8df028e4e080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:54 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-8369fb08-11cc-4c48-97d6-679a1223d024 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Volume 43ae7732-5953-4573-b187-7ebe32f85977: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43ae7732-5953-4573-b187-7ebe32f85977', 'volume_size': 1}
Apr 02 10:34:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8369fb08-11cc-4c48-97d6-679a1223d024 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:54 devstack sudo[90068]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1a23fe5e-f45e-4518-86af-1683d327ec12 tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-00afe3f0-3f1a-4abd-bc18-3fe771c763d0" returned: 0 in 0.546s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1a23fe5e-f45e-4518-86af-1683d327ec12 tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-00afe3f0-3f1a-4abd-bc18-3fe771c763d0 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:54 devstack sudo[90078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-00afe3f0-3f1a-4abd-bc18-3fe771c763d0
Apr 02 10:34:54 devstack sudo[90078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:54 devstack sudo[90069]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4" returned: 0 in 0.534s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:54 devstack cinder-volume[82102]: DEBUG cinder.utils [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Path /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8367d611-3cbd-49eb-82b4-b95dfd2607f3 not found in is_blk_device check {{(pid=82102) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 02 10:34:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8367d611-3cbd-49eb-82b4-b95dfd2607f3 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:54 devstack sudo[90080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8367d611-3cbd-49eb-82b4-b95dfd2607f3
Apr 02 10:34:54 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:54 devstack sudo[90078]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:54 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1a23fe5e-f45e-4518-86af-1683d327ec12 tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-00afe3f0-3f1a-4abd-bc18-3fe771c763d0" returned: 0 in 0.453s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:54 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1a23fe5e-f45e-4518-86af-1683d327ec12 tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "cinder-quobyte-00afe3f0-3f1a-4abd-bc18-3fe771c763d0" released by "delete_volume" :: held 1.028s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:34:55 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-1a23fe5e-f45e-4518-86af-1683d327ec12 tempest-CreateVolumesFromSnapshotTest-389980398 None] Created reservations ['e41ee8d9-9edf-4e72-9697-6515796c24aa', '03dd0fb3-6f35-4f7e-95f2-cb655ae3e6e5', '4314400c-0c95-4e98-b134-42c2fc7ad754', '798e94c9-d28e-4dce-acc4-74a8f193c26f'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:34:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-1a23fe5e-f45e-4518-86af-1683d327ec12 tempest-CreateVolumesFromSnapshotTest-389980398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-1a23fe5e-f45e-4518-86af-1683d327ec12 tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:55 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-1a23fe5e-f45e-4518-86af-1683d327ec12 tempest-CreateVolumesFromSnapshotTest-389980398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:34:55 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-1a23fe5e-f45e-4518-86af-1683d327ec12 tempest-CreateVolumesFromSnapshotTest-389980398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:34:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-1a23fe5e-f45e-4518-86af-1683d327ec12 tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:55 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1a23fe5e-f45e-4518-86af-1683d327ec12 tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:55 devstack sudo[90093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:34:55 devstack sudo[90093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:56 devstack sudo[90093]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1a23fe5e-f45e-4518-86af-1683d327ec12 tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 1.071s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:56 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-1a23fe5e-f45e-4518-86af-1683d327ec12 tempest-CreateVolumesFromSnapshotTest-389980398 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:34:56 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-1a23fe5e-f45e-4518-86af-1683d327ec12 tempest-CreateVolumesFromSnapshotTest-389980398 None] Deleted volume successfully.
Apr 02 10:34:56 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-0d10eb3c-7244-447d-9022-2a070689d90b tempest-CreateVolumesFromSnapshotTest-389980398 None] Acquiring lock "cinder-098058c5-6adb-4ce4-b94b-5ca61c821cd2-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:56 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-0d10eb3c-7244-447d-9022-2a070689d90b tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "cinder-098058c5-6adb-4ce4-b94b-5ca61c821cd2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:56 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1a23fe5e-f45e-4518-86af-1683d327ec12 tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "cinder-00afe3f0-3f1a-4abd-bc18-3fe771c763d0-delete_volume" released by "delete_volume" :: held 2.572s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:34:56 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-0d10eb3c-7244-447d-9022-2a070689d90b tempest-CreateVolumesFromSnapshotTest-389980398 None] Acquiring lock "cinder-quobyte-098058c5-6adb-4ce4-b94b-5ca61c821cd2" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:56 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-0d10eb3c-7244-447d-9022-2a070689d90b tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "cinder-quobyte-098058c5-6adb-4ce4-b94b-5ca61c821cd2" acquired by "delete_volume" :: waited 0.045s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:56 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8c0c96-f1f0-4449-b019-f338d6afdafb]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:34:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0d10eb3c-7244-447d-9022-2a070689d90b tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-098058c5-6adb-4ce4-b94b-5ca61c821cd2 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:56 devstack sudo[90096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-098058c5-6adb-4ce4-b94b-5ca61c821cd2
Apr 02 10:34:56 devstack sudo[90096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:56 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8367d611-3cbd-49eb-82b4-b95dfd2607f3" returned: 0 in 2.379s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:56 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6703f8-2a51-41fc-9dd9-2d563686ab8a]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:34:56 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:56 devstack sudo[90098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4
Apr 02 10:34:56 devstack sudo[90098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:57 devstack sudo[90096]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0d10eb3c-7244-447d-9022-2a070689d90b tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-098058c5-6adb-4ce4-b94b-5ca61c821cd2" returned: 0 in 0.579s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0d10eb3c-7244-447d-9022-2a070689d90b tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-098058c5-6adb-4ce4-b94b-5ca61c821cd2 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:57 devstack sudo[90103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-098058c5-6adb-4ce4-b94b-5ca61c821cd2
Apr 02 10:34:57 devstack sudo[90103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:57 devstack sudo[90098]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4" returned: 0 in 0.573s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:57 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Image conversion details: src /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4, size 1024.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8367d611-3cbd-49eb-82b4-b95dfd2607f3 {{(pid=82102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 02 10:34:57 devstack cinder-volume[82102]: INFO cinder.image.image_utils [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Converted 1024.00 MB image at 430.27 MB/s
Apr 02 10:34:57 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8367d611-3cbd-49eb-82b4-b95dfd2607f3 is being set with open permissions: ugo+rw
Apr 02 10:34:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8367d611-3cbd-49eb-82b4-b95dfd2607f3 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:57 devstack sudo[90108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8367d611-3cbd-49eb-82b4-b95dfd2607f3
Apr 02 10:34:57 devstack sudo[90108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:57 devstack sudo[90103]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0d10eb3c-7244-447d-9022-2a070689d90b tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-098058c5-6adb-4ce4-b94b-5ca61c821cd2" returned: 0 in 0.393s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:57 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-0d10eb3c-7244-447d-9022-2a070689d90b tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "cinder-quobyte-098058c5-6adb-4ce4-b94b-5ca61c821cd2" released by "delete_volume" :: held 1.016s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:34:57 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-0d10eb3c-7244-447d-9022-2a070689d90b tempest-CreateVolumesFromSnapshotTest-389980398 None] Created reservations ['8d9b9d30-ec21-4761-b0da-c5b2b9fcb97e', 'a963e3e4-2d6c-4f79-a5dd-069a33840a92', 'aea8fac0-585c-4c29-b308-6caf5abe6d5d', 'f0277b23-1ccb-4c73-aff6-210439fd4d48'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:34:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-0d10eb3c-7244-447d-9022-2a070689d90b tempest-CreateVolumesFromSnapshotTest-389980398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-0d10eb3c-7244-447d-9022-2a070689d90b tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:57 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-0d10eb3c-7244-447d-9022-2a070689d90b tempest-CreateVolumesFromSnapshotTest-389980398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:34:57 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-0d10eb3c-7244-447d-9022-2a070689d90b tempest-CreateVolumesFromSnapshotTest-389980398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:34:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-0d10eb3c-7244-447d-9022-2a070689d90b tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0d10eb3c-7244-447d-9022-2a070689d90b tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:57 devstack sudo[90111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:34:57 devstack sudo[90111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:57 devstack sudo[90108]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8367d611-3cbd-49eb-82b4-b95dfd2607f3" returned: 0 in 0.412s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:57 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Lock "cinder-quobyte-8367d611-3cbd-49eb-82b4-b95dfd2607f3" released by "_copy_volume_from_snapshot" :: held 4.563s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:34:57 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Lock "cinder-quobyte-d31db937-6e4c-456b-8967-94d7f696268c-8367d611-3cbd-49eb-82b4-b95dfd2607f3" released by "_create_volume_from_snapshot" :: held 4.591s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:34:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.626s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d49ec41b-c656-4726-91d4-dbb46f7ec4f4 tempest-SnapshotDependencyTests-1378294697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.555s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:57 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d49ec41b-c656-4726-91d4-dbb46f7ec4f4 tempest-SnapshotDependencyTests-1378294697 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1624821464',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3219e7c-4a2a-4201-b860-13d416841808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ce0288e3a504e1184f345b0f2c613d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:51Z,use_quota=True,user_id='6a217c4bec2f455b87f5bbaef1061824',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:34:57 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-d49ec41b-c656-4726-91d4-dbb46f7ec4f4 tempest-SnapshotDependencyTests-1378294697 None] Creating volume e3219e7c-4a2a-4201-b860-13d416841808 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:34:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d49ec41b-c656-4726-91d4-dbb46f7ec4f4 tempest-SnapshotDependencyTests-1378294697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d49ec41b-c656-4726-91d4-dbb46f7ec4f4 tempest-SnapshotDependencyTests-1378294697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:57 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d49ec41b-c656-4726-91d4-dbb46f7ec4f4 tempest-SnapshotDependencyTests-1378294697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:34:57 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d49ec41b-c656-4726-91d4-dbb46f7ec4f4 tempest-SnapshotDependencyTests-1378294697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:34:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d49ec41b-c656-4726-91d4-dbb46f7ec4f4 tempest-SnapshotDependencyTests-1378294697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:57 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d49ec41b-c656-4726-91d4-dbb46f7ec4f4 tempest-SnapshotDependencyTests-1378294697 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:34:57 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-d49ec41b-c656-4726-91d4-dbb46f7ec4f4 tempest-SnapshotDependencyTests-1378294697 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:34:57 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d49ec41b-c656-4726-91d4-dbb46f7ec4f4 tempest-SnapshotDependencyTests-1378294697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:57 devstack sudo[90114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808 1073741824
Apr 02 10:34:57 devstack sudo[90114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:57 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baeced67-cea8-4a90-b779-fe4cf31b2749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8367d611-3cbd-49eb-82b4-b95dfd2607f3', 'volume_size': 1, 'snapshot_id': 'd31db937-6e4c-456b-8967-94d7f696268c'}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:57 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e199069-90e8-4bbe-9790-6a0bd757649c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:57 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Volume volume-8367d611-3cbd-49eb-82b4-b95dfd2607f3 (8367d611-3cbd-49eb-82b4-b95dfd2607f3): created successfully
Apr 02 10:34:57 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e199069-90e8-4bbe-9790-6a0bd757649c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:57 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Flow 'volume_create_manager' (583b1a9a-6b63-46e7-96b0-73b8811be422) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:34:57 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-8aa9eff2-cfe7-479c-8f9e-51df9933561e tempest-VolumeDependencyTests-1466340 None] Created volume successfully.
Apr 02 10:34:58 devstack sudo[90111]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0d10eb3c-7244-447d-9022-2a070689d90b tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.403s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:58 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-0d10eb3c-7244-447d-9022-2a070689d90b tempest-CreateVolumesFromSnapshotTest-389980398 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:34:58 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-0d10eb3c-7244-447d-9022-2a070689d90b tempest-CreateVolumesFromSnapshotTest-389980398 None] Deleted volume successfully.
Apr 02 10:34:58 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-0d10eb3c-7244-447d-9022-2a070689d90b tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "cinder-098058c5-6adb-4ce4-b94b-5ca61c821cd2-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:34:58 devstack sudo[90114]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d49ec41b-c656-4726-91d4-dbb46f7ec4f4 tempest-SnapshotDependencyTests-1378294697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808 1073741824" returned: 0 in 0.483s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d49ec41b-c656-4726-91d4-dbb46f7ec4f4 tempest-SnapshotDependencyTests-1378294697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:58 devstack sudo[90120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808
Apr 02 10:34:58 devstack sudo[90120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:58 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9bf31685-ce13-4a3a-a87b-2cdfa367f94d tempest-CreateVolumesFromSnapshotTest-389980398 None] Acquiring lock "cinder-a8dbdc3a-f2b6-4c9b-a5b9-1a30a2a93607-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:58 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9bf31685-ce13-4a3a-a87b-2cdfa367f94d tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "cinder-a8dbdc3a-f2b6-4c9b-a5b9-1a30a2a93607-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:58 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9bf31685-ce13-4a3a-a87b-2cdfa367f94d tempest-CreateVolumesFromSnapshotTest-389980398 None] Acquiring lock "cinder-quobyte-a8dbdc3a-f2b6-4c9b-a5b9-1a30a2a93607" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:58 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9bf31685-ce13-4a3a-a87b-2cdfa367f94d tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "cinder-quobyte-a8dbdc3a-f2b6-4c9b-a5b9-1a30a2a93607" acquired by "delete_volume" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:58 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[484005a8-9ddf-444a-9108-78ba9ac56780]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:34:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9bf31685-ce13-4a3a-a87b-2cdfa367f94d tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8dbdc3a-f2b6-4c9b-a5b9-1a30a2a93607 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:58 devstack sudo[90122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8dbdc3a-f2b6-4c9b-a5b9-1a30a2a93607
Apr 02 10:34:58 devstack sudo[90122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:58 devstack sudo[90120]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d49ec41b-c656-4726-91d4-dbb46f7ec4f4 tempest-SnapshotDependencyTests-1378294697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808" returned: 0 in 0.399s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:58 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d49ec41b-c656-4726-91d4-dbb46f7ec4f4 tempest-SnapshotDependencyTests-1378294697 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:34:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d49ec41b-c656-4726-91d4-dbb46f7ec4f4 tempest-SnapshotDependencyTests-1378294697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8369fb08-11cc-4c48-97d6-679a1223d024 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.765s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:58 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8369fb08-11cc-4c48-97d6-679a1223d024 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-65741894',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43ae7732-5953-4573-b187-7ebe32f85977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248b8da63e634c2f8c52ada62001338d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:34:54Z,use_quota=True,user_id='ecb05c1834da450fa82b5fb1a058c81a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:34:58 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-8369fb08-11cc-4c48-97d6-679a1223d024 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Creating volume 43ae7732-5953-4573-b187-7ebe32f85977 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:34:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8369fb08-11cc-4c48-97d6-679a1223d024 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8369fb08-11cc-4c48-97d6-679a1223d024 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:58 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8369fb08-11cc-4c48-97d6-679a1223d024 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:34:58 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8369fb08-11cc-4c48-97d6-679a1223d024 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:34:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8369fb08-11cc-4c48-97d6-679a1223d024 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:58 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8369fb08-11cc-4c48-97d6-679a1223d024 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:34:58 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-8369fb08-11cc-4c48-97d6-679a1223d024 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:34:58 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8369fb08-11cc-4c48-97d6-679a1223d024 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-43ae7732-5953-4573-b187-7ebe32f85977 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:58 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d49ec41b-c656-4726-91d4-dbb46f7ec4f4 tempest-SnapshotDependencyTests-1378294697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b8fdec8-c278-4238-8c13-1f1ac307c1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3219e7c-4a2a-4201-b860-13d416841808', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:58 devstack sudo[90125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-43ae7732-5953-4573-b187-7ebe32f85977 1073741824
Apr 02 10:34:58 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d49ec41b-c656-4726-91d4-dbb46f7ec4f4 tempest-SnapshotDependencyTests-1378294697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f3e8ea-de93-4a89-aa9e-5fe4f875bb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:58 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:58 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-d49ec41b-c656-4726-91d4-dbb46f7ec4f4 tempest-SnapshotDependencyTests-1378294697 None] Volume volume-e3219e7c-4a2a-4201-b860-13d416841808 (e3219e7c-4a2a-4201-b860-13d416841808): created successfully
Apr 02 10:34:58 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d49ec41b-c656-4726-91d4-dbb46f7ec4f4 tempest-SnapshotDependencyTests-1378294697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f3e8ea-de93-4a89-aa9e-5fe4f875bb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:58 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d49ec41b-c656-4726-91d4-dbb46f7ec4f4 tempest-SnapshotDependencyTests-1378294697 None] Flow 'volume_create_manager' (58dfc955-45ec-4e01-b42e-8331063a57ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:34:58 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-d49ec41b-c656-4726-91d4-dbb46f7ec4f4 tempest-SnapshotDependencyTests-1378294697 None] Created volume successfully.
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-7ecb1e1c-c814-4e35-8b1b-c4a5046e613a tempest-VolumeDependencyTests-1466340 None] Acquiring lock "cinder-d31db937-6e4c-456b-8967-94d7f696268c-delete_snapshot" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-7ecb1e1c-c814-4e35-8b1b-c4a5046e613a tempest-VolumeDependencyTests-1466340 None] Lock "cinder-d31db937-6e4c-456b-8967-94d7f696268c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-7ecb1e1c-c814-4e35-8b1b-c4a5046e613a tempest-VolumeDependencyTests-1466340 None] Acquiring lock "cinder-quobyte-969474f1-5ffe-4167-8ae9-a9354bcca1d4" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-7ecb1e1c-c814-4e35-8b1b-c4a5046e613a tempest-VolumeDependencyTests-1466340 None] Lock "cinder-quobyte-969474f1-5ffe-4167-8ae9-a9354bcca1d4" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-7ecb1e1c-c814-4e35-8b1b-c4a5046e613a tempest-VolumeDependencyTests-1466340 None] Acquiring lock "cinder-quobyte-d31db937-6e4c-456b-8967-94d7f696268c" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-7ecb1e1c-c814-4e35-8b1b-c4a5046e613a tempest-VolumeDependencyTests-1466340 None] Lock "cinder-quobyte-d31db937-6e4c-456b-8967-94d7f696268c" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-7ecb1e1c-c814-4e35-8b1b-c4a5046e613a tempest-VolumeDependencyTests-1466340 None] Deleting offline snapshot d31db937-6e4c-456b-8967-94d7f696268c of volume 969474f1-5ffe-4167-8ae9-a9354bcca1d4 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-7ecb1e1c-c814-4e35-8b1b-c4a5046e613a tempest-VolumeDependencyTests-1466340 None] snapshot_file for this snap is: volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4.d31db937-6e4c-456b-8967-94d7f696268c {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d003a57-1bf6-4d11-8ca4-9d4857a9bd24]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7ecb1e1c-c814-4e35-8b1b-c4a5046e613a tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4.d31db937-6e4c-456b-8967-94d7f696268c {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:59 devstack sudo[90122]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9bf31685-ce13-4a3a-a87b-2cdfa367f94d tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8dbdc3a-f2b6-4c9b-a5b9-1a30a2a93607" returned: 0 in 0.474s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9bf31685-ce13-4a3a-a87b-2cdfa367f94d tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8dbdc3a-f2b6-4c9b-a5b9-1a30a2a93607 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:59 devstack sudo[90131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8dbdc3a-f2b6-4c9b-a5b9-1a30a2a93607
Apr 02 10:34:59 devstack sudo[90131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:59 devstack sudo[90130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4.d31db937-6e4c-456b-8967-94d7f696268c
Apr 02 10:34:59 devstack sudo[90130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:59 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8369fb08-11cc-4c48-97d6-679a1223d024 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-43ae7732-5953-4573-b187-7ebe32f85977 1073741824" returned: 0 in 0.546s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8369fb08-11cc-4c48-97d6-679a1223d024 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-43ae7732-5953-4573-b187-7ebe32f85977 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:59 devstack sudo[90137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-43ae7732-5953-4573-b187-7ebe32f85977
Apr 02 10:34:59 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:59 devstack sudo[90131]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:59 devstack sudo[90130]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9bf31685-ce13-4a3a-a87b-2cdfa367f94d tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-a8dbdc3a-f2b6-4c9b-a5b9-1a30a2a93607" returned: 0 in 0.467s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7ecb1e1c-c814-4e35-8b1b-c4a5046e613a tempest-VolumeDependencyTests-1466340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4.d31db937-6e4c-456b-8967-94d7f696268c" returned: 0 in 0.489s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-7ecb1e1c-c814-4e35-8b1b-c4a5046e613a tempest-VolumeDependencyTests-1466340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9bf31685-ce13-4a3a-a87b-2cdfa367f94d tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "cinder-quobyte-a8dbdc3a-f2b6-4c9b-a5b9-1a30a2a93607" released by "delete_volume" :: held 0.984s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee5e80d-9e92-408f-957b-a37fefc4a01f]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7ecb1e1c-c814-4e35-8b1b-c4a5046e613a tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-9bf31685-ce13-4a3a-a87b-2cdfa367f94d tempest-CreateVolumesFromSnapshotTest-389980398 None] Created reservations ['70b3ff95-3dc8-45d6-86cc-b0771ebb6ea4', '95a6f1d2-cf4d-4d5a-a8ec-c482f7393a00', '2e4b8e82-7ac3-429f-adc6-f55ff924a9f9', '007d47ca-01c4-4a88-a0cd-826571f604a0'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:34:59 devstack sudo[90143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4
Apr 02 10:34:59 devstack sudo[90143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-9bf31685-ce13-4a3a-a87b-2cdfa367f94d tempest-CreateVolumesFromSnapshotTest-389980398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-9bf31685-ce13-4a3a-a87b-2cdfa367f94d tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-9bf31685-ce13-4a3a-a87b-2cdfa367f94d tempest-CreateVolumesFromSnapshotTest-389980398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-9bf31685-ce13-4a3a-a87b-2cdfa367f94d tempest-CreateVolumesFromSnapshotTest-389980398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-9bf31685-ce13-4a3a-a87b-2cdfa367f94d tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9bf31685-ce13-4a3a-a87b-2cdfa367f94d tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-01d837e0-4915-4248-a386-0a4280bcb0fd tempest-CreateVolumesFromSnapshotTest-389980398 None] Acquiring lock "cinder-34c8b1fe-4417-4843-8e7c-e5beff9bb3a0-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:59 devstack sudo[90145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:34:59 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-01d837e0-4915-4248-a386-0a4280bcb0fd tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "cinder-34c8b1fe-4417-4843-8e7c-e5beff9bb3a0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-01d837e0-4915-4248-a386-0a4280bcb0fd tempest-CreateVolumesFromSnapshotTest-389980398 None] Acquiring lock "cinder-quobyte-34c8b1fe-4417-4843-8e7c-e5beff9bb3a0" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-01d837e0-4915-4248-a386-0a4280bcb0fd tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "cinder-quobyte-34c8b1fe-4417-4843-8e7c-e5beff9bb3a0" acquired by "delete_volume" :: waited 0.012s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9eae4f-a833-453f-905e-8ffb934643cf]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-01d837e0-4915-4248-a386-0a4280bcb0fd tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34c8b1fe-4417-4843-8e7c-e5beff9bb3a0 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:34:59 devstack sudo[90148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34c8b1fe-4417-4843-8e7c-e5beff9bb3a0
Apr 02 10:34:59 devstack sudo[90148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:34:59 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-8369fb08-11cc-4c48-97d6-679a1223d024 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-43ae7732-5953-4573-b187-7ebe32f85977" returned: 0 in 0.446s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-8369fb08-11cc-4c48-97d6-679a1223d024 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-8369fb08-11cc-4c48-97d6-679a1223d024 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8369fb08-11cc-4c48-97d6-679a1223d024 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67347781-8439-4014-8d0e-8df028e4e080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43ae7732-5953-4573-b187-7ebe32f85977', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8369fb08-11cc-4c48-97d6-679a1223d024 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e071e28-08a0-4b7c-9bb3-e52db0b55f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:34:59 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-8369fb08-11cc-4c48-97d6-679a1223d024 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Volume volume-43ae7732-5953-4573-b187-7ebe32f85977 (43ae7732-5953-4573-b187-7ebe32f85977): created successfully
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8369fb08-11cc-4c48-97d6-679a1223d024 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e071e28-08a0-4b7c-9bb3-e52db0b55f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:34:59 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-8369fb08-11cc-4c48-97d6-679a1223d024 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Flow 'volume_create_manager' (2e60f5b6-5469-4867-b570-38a7637e41f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:34:59 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-8369fb08-11cc-4c48-97d6-679a1223d024 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Created volume successfully.
Apr 02 10:35:00 devstack sudo[90143]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7ecb1e1c-c814-4e35-8b1b-c4a5046e613a tempest-VolumeDependencyTests-1466340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4" returned: 0 in 0.573s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7ecb1e1c-c814-4e35-8b1b-c4a5046e613a tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4.d31db937-6e4c-456b-8967-94d7f696268c {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:00 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9bf31685-ce13-4a3a-a87b-2cdfa367f94d tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.493s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:00 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-9bf31685-ce13-4a3a-a87b-2cdfa367f94d tempest-CreateVolumesFromSnapshotTest-389980398 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:35:00 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-9bf31685-ce13-4a3a-a87b-2cdfa367f94d tempest-CreateVolumesFromSnapshotTest-389980398 None] Deleted volume successfully.
Apr 02 10:35:00 devstack sudo[90154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4.d31db937-6e4c-456b-8967-94d7f696268c
Apr 02 10:35:00 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:00 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9bf31685-ce13-4a3a-a87b-2cdfa367f94d tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "cinder-a8dbdc3a-f2b6-4c9b-a5b9-1a30a2a93607-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-70d8ffb6-482c-4bf6-bfd3-b9d3ddec6906 tempest-SnapshotDependencyTests-1378294697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-70d8ffb6-482c-4bf6-bfd3-b9d3ddec6906 tempest-SnapshotDependencyTests-1378294697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:00 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-70d8ffb6-482c-4bf6-bfd3-b9d3ddec6906 tempest-SnapshotDependencyTests-1378294697 None] Creating offline snapshot 8b3640d3-cd51-48f2-9d70-db5eaeff9a44 of volume e3219e7c-4a2a-4201-b860-13d416841808 {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:35:00 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[87347818-85a5-4eb2-91ab-1f4d370aac5c]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:35:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-70d8ffb6-482c-4bf6-bfd3-b9d3ddec6906 tempest-SnapshotDependencyTests-1378294697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:00 devstack sudo[90157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808
Apr 02 10:35:00 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:00 devstack sudo[90148]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-01d837e0-4915-4248-a386-0a4280bcb0fd tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34c8b1fe-4417-4843-8e7c-e5beff9bb3a0" returned: 0 in 0.564s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-01d837e0-4915-4248-a386-0a4280bcb0fd tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34c8b1fe-4417-4843-8e7c-e5beff9bb3a0 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:00 devstack sudo[90161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34c8b1fe-4417-4843-8e7c-e5beff9bb3a0
Apr 02 10:35:00 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:00 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7ecb1e1c-c814-4e35-8b1b-c4a5046e613a tempest-VolumeDependencyTests-1466340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4.d31db937-6e4c-456b-8967-94d7f696268c" returned: 0 in 0.497s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7ecb1e1c-c814-4e35-8b1b-c4a5046e613a tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4.d31db937-6e4c-456b-8967-94d7f696268c {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:00 devstack sudo[90166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4.d31db937-6e4c-456b-8967-94d7f696268c
Apr 02 10:35:00 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:00 devstack cinder-volume[82102]: DEBUG dbcounter [-] [82102] Writing DB stats cinder:SELECT=111,cinder:UPDATE=158,cinder:INSERT=38,cinder:DELETE=14 {{(pid=82102) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 02 10:35:00 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-23b3b2e2-c562-490c-b3eb-2184533a0f65 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:35:00 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-23b3b2e2-c562-490c-b3eb-2184533a0f65 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Flow 'volume_create_manager' (9673824c-26e4-4816-8f61-ca6446fbc2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:35:00 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-23b3b2e2-c562-490c-b3eb-2184533a0f65 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe6a6b5-f519-431a-b9e2-4ae8b12663cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:00 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-23b3b2e2-c562-490c-b3eb-2184533a0f65 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe6a6b5-f519-431a-b9e2-4ae8b12663cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-425160777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a1dadd0-5c92-4917-ae8f-15528be072f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248b8da63e634c2f8c52ada62001338d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:35:01Z,use_quota=True,user_id='ecb05c1834da450fa82b5fb1a058c81a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:00 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-23b3b2e2-c562-490c-b3eb-2184533a0f65 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dcab7c7-516c-4fd0-bf10-f9c2ce7fb999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:00 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-23b3b2e2-c562-490c-b3eb-2184533a0f65 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dcab7c7-516c-4fd0-bf10-f9c2ce7fb999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:00 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-23b3b2e2-c562-490c-b3eb-2184533a0f65 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbf58056-1b7c-4101-95c1-58f654a81a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:00 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-23b3b2e2-c562-490c-b3eb-2184533a0f65 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbf58056-1b7c-4101-95c1-58f654a81a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a1dadd0-5c92-4917-ae8f-15528be072f3', 'volume_name': 'volume-4a1dadd0-5c92-4917-ae8f-15528be072f3', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:00 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-23b3b2e2-c562-490c-b3eb-2184533a0f65 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f52801-ed47-4b87-8342-74141e4080c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:00 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-23b3b2e2-c562-490c-b3eb-2184533a0f65 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f52801-ed47-4b87-8342-74141e4080c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:00 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:00 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-23b3b2e2-c562-490c-b3eb-2184533a0f65 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf15b60-30cf-481b-bd31-43e8584801bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:00 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-23b3b2e2-c562-490c-b3eb-2184533a0f65 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Volume 4a1dadd0-5c92-4917-ae8f-15528be072f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a1dadd0-5c92-4917-ae8f-15528be072f3', 'volume_size': 1}
Apr 02 10:35:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-23b3b2e2-c562-490c-b3eb-2184533a0f65 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-70d8ffb6-482c-4bf6-bfd3-b9d3ddec6906 tempest-SnapshotDependencyTests-1378294697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808" returned: 0 in 0.613s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-70d8ffb6-482c-4bf6-bfd3-b9d3ddec6906 tempest-SnapshotDependencyTests-1378294697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808.8b3640d3-cd51-48f2-9d70-db5eaeff9a44 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:00 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:00 devstack sudo[90172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808.8b3640d3-cd51-48f2-9d70-db5eaeff9a44 1G
Apr 02 10:35:00 devstack sudo[90172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:00 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-01d837e0-4915-4248-a386-0a4280bcb0fd tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-34c8b1fe-4417-4843-8e7c-e5beff9bb3a0" returned: 0 in 0.535s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:00 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-01d837e0-4915-4248-a386-0a4280bcb0fd tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "cinder-quobyte-34c8b1fe-4417-4843-8e7c-e5beff9bb3a0" released by "delete_volume" :: held 1.133s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:00 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-01d837e0-4915-4248-a386-0a4280bcb0fd tempest-CreateVolumesFromSnapshotTest-389980398 None] Created reservations ['d99dd29b-36d1-4296-acea-505e7e43aa16', '4b674124-eee1-4b12-b04d-a99f77096d84', '29844653-f446-4aea-abb3-0ecda9db34d3', '6443f264-af98-4d3b-aa72-46df035f467f'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-95e7a1d6-9001-4c6a-bbb8-51afafc277c4 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-95e7a1d6-9001-4c6a-bbb8-51afafc277c4 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Flow 'volume_create_manager' (4af6aff1-2952-4515-ae47-3cb22a2d67dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-95e7a1d6-9001-4c6a-bbb8-51afafc277c4 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56cdece3-851d-4d2f-aa9f-ebfcb20dd131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-95e7a1d6-9001-4c6a-bbb8-51afafc277c4 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56cdece3-851d-4d2f-aa9f-ebfcb20dd131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-535469776',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=816eea4d-0717-47d5-bee7-6794d3de2fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248b8da63e634c2f8c52ada62001338d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:35:01Z,use_quota=True,user_id='ecb05c1834da450fa82b5fb1a058c81a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-95e7a1d6-9001-4c6a-bbb8-51afafc277c4 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eec6ccad-43ac-4a74-abb7-f0cada1dab8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-95e7a1d6-9001-4c6a-bbb8-51afafc277c4 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eec6ccad-43ac-4a74-abb7-f0cada1dab8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-95e7a1d6-9001-4c6a-bbb8-51afafc277c4 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c715045-58be-4049-9a3c-f6aeaa4263f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-95e7a1d6-9001-4c6a-bbb8-51afafc277c4 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c715045-58be-4049-9a3c-f6aeaa4263f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '816eea4d-0717-47d5-bee7-6794d3de2fe8', 'volume_name': 'volume-816eea4d-0717-47d5-bee7-6794d3de2fe8', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-95e7a1d6-9001-4c6a-bbb8-51afafc277c4 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6617238-c40c-4549-a15f-11c3eab26fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-95e7a1d6-9001-4c6a-bbb8-51afafc277c4 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6617238-c40c-4549-a15f-11c3eab26fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-95e7a1d6-9001-4c6a-bbb8-51afafc277c4 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad711e1-2433-466a-a57f-091d6d42122c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:01 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-95e7a1d6-9001-4c6a-bbb8-51afafc277c4 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Volume 816eea4d-0717-47d5-bee7-6794d3de2fe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-816eea4d-0717-47d5-bee7-6794d3de2fe8', 'volume_size': 1}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-95e7a1d6-9001-4c6a-bbb8-51afafc277c4 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-01d837e0-4915-4248-a386-0a4280bcb0fd tempest-CreateVolumesFromSnapshotTest-389980398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-01d837e0-4915-4248-a386-0a4280bcb0fd tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-01d837e0-4915-4248-a386-0a4280bcb0fd tempest-CreateVolumesFromSnapshotTest-389980398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-01d837e0-4915-4248-a386-0a4280bcb0fd tempest-CreateVolumesFromSnapshotTest-389980398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-01d837e0-4915-4248-a386-0a4280bcb0fd tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-01d837e0-4915-4248-a386-0a4280bcb0fd tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:01 devstack sudo[90175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:35:01 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-08810666-95a2-434b-bfd4-6f47b7cb4e37 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-08810666-95a2-434b-bfd4-6f47b7cb4e37 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Flow 'volume_create_manager' (9f925054-4be6-4e2c-977b-8ad5f4337f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-08810666-95a2-434b-bfd4-6f47b7cb4e37 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3788818-91ad-4616-925d-6398de72a558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-08810666-95a2-434b-bfd4-6f47b7cb4e37 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3788818-91ad-4616-925d-6398de72a558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1906596528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3e6d57-b40f-4aa2-a974-37c7d0b7ee00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248b8da63e634c2f8c52ada62001338d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:35:01Z,use_quota=True,user_id='ecb05c1834da450fa82b5fb1a058c81a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-08810666-95a2-434b-bfd4-6f47b7cb4e37 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9eae185-b5df-4fd1-962a-a091958acf2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-08810666-95a2-434b-bfd4-6f47b7cb4e37 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9eae185-b5df-4fd1-962a-a091958acf2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-08810666-95a2-434b-bfd4-6f47b7cb4e37 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f8d985-42bb-4b2e-beb1-30f237c771cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-08810666-95a2-434b-bfd4-6f47b7cb4e37 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f8d985-42bb-4b2e-beb1-30f237c771cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee3e6d57-b40f-4aa2-a974-37c7d0b7ee00', 'volume_name': 'volume-ee3e6d57-b40f-4aa2-a974-37c7d0b7ee00', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-08810666-95a2-434b-bfd4-6f47b7cb4e37 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03d46836-7b06-4039-9510-f03e0ad4701e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-08810666-95a2-434b-bfd4-6f47b7cb4e37 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03d46836-7b06-4039-9510-f03e0ad4701e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-08810666-95a2-434b-bfd4-6f47b7cb4e37 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab300264-4e77-4f54-a445-ba4be65d85ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:01 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-08810666-95a2-434b-bfd4-6f47b7cb4e37 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Volume ee3e6d57-b40f-4aa2-a974-37c7d0b7ee00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee3e6d57-b40f-4aa2-a974-37c7d0b7ee00', 'volume_size': 1}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-08810666-95a2-434b-bfd4-6f47b7cb4e37 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-499ba04f-1cbc-4c92-a104-b21561484923 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:35:01 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-499ba04f-1cbc-4c92-a104-b21561484923 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Flow 'volume_create_manager' (6b826227-0d7e-49e9-b59f-d5628f44b9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-499ba04f-1cbc-4c92-a104-b21561484923 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f84855-db8d-4c31-9d38-454425bb2572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7ecb1e1c-c814-4e35-8b1b-c4a5046e613a tempest-VolumeDependencyTests-1466340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4.d31db937-6e4c-456b-8967-94d7f696268c" returned: 0 in 0.796s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-499ba04f-1cbc-4c92-a104-b21561484923 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f84855-db8d-4c31-9d38-454425bb2572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-852570667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36ee8c1a-4900-434b-be0d-83e9eb870164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248b8da63e634c2f8c52ada62001338d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:35:01Z,use_quota=True,user_id='ecb05c1834da450fa82b5fb1a058c81a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-499ba04f-1cbc-4c92-a104-b21561484923 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5829f23-964b-4ba6-8617-e173c9be2355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:01 devstack sudo[90172]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-499ba04f-1cbc-4c92-a104-b21561484923 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5829f23-964b-4ba6-8617-e173c9be2355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-499ba04f-1cbc-4c92-a104-b21561484923 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb169c8c-9dfd-4d3a-a4de-3bf527651048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-499ba04f-1cbc-4c92-a104-b21561484923 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb169c8c-9dfd-4d3a-a4de-3bf527651048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36ee8c1a-4900-434b-be0d-83e9eb870164', 'volume_name': 'volume-36ee8c1a-4900-434b-be0d-83e9eb870164', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-499ba04f-1cbc-4c92-a104-b21561484923 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e7f5f73-ea50-47c0-934a-59de251a95ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-499ba04f-1cbc-4c92-a104-b21561484923 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e7f5f73-ea50-47c0-934a-59de251a95ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-499ba04f-1cbc-4c92-a104-b21561484923 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd16830-d238-4f06-81f6-cbe505ad6a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:01 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-499ba04f-1cbc-4c92-a104-b21561484923 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Volume 36ee8c1a-4900-434b-be0d-83e9eb870164: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36ee8c1a-4900-434b-be0d-83e9eb870164', 'volume_size': 1}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-499ba04f-1cbc-4c92-a104-b21561484923 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-7ecb1e1c-c814-4e35-8b1b-c4a5046e613a tempest-VolumeDependencyTests-1466340 None] Lock "cinder-quobyte-d31db937-6e4c-456b-8967-94d7f696268c" released by "_delete_snapshot" :: held 2.458s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-70d8ffb6-482c-4bf6-bfd3-b9d3ddec6906 tempest-SnapshotDependencyTests-1378294697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808.8b3640d3-cd51-48f2-9d70-db5eaeff9a44 1G" returned: 0 in 0.658s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-70d8ffb6-482c-4bf6-bfd3-b9d3ddec6906 tempest-SnapshotDependencyTests-1378294697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3219e7c-4a2a-4201-b860-13d416841808 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808.8b3640d3-cd51-48f2-9d70-db5eaeff9a44 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-7ecb1e1c-c814-4e35-8b1b-c4a5046e613a tempest-VolumeDependencyTests-1466340 None] Lock "cinder-quobyte-969474f1-5ffe-4167-8ae9-a9354bcca1d4" released by "delete_snapshot" :: held 2.482s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:01 devstack sudo[90181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3219e7c-4a2a-4201-b860-13d416841808 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808.8b3640d3-cd51-48f2-9d70-db5eaeff9a44
Apr 02 10:35:01 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG dbcounter [-] [82102] Writing DB stats cinder:SELECT=131,cinder:UPDATE=170,cinder:DELETE=18,cinder:INSERT=36 {{(pid=82102) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-e926d73d-279a-43dc-94dc-65641cc3a6ed tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e926d73d-279a-43dc-94dc-65641cc3a6ed tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Flow 'volume_create_manager' (fa683c27-4db0-4493-87e1-14c0cd81c06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e926d73d-279a-43dc-94dc-65641cc3a6ed tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a01c1abc-ecdd-4d5b-9b38-4693277d1113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e926d73d-279a-43dc-94dc-65641cc3a6ed tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a01c1abc-ecdd-4d5b-9b38-4693277d1113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-668491870',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32404c33-06c9-4362-b3ce-402d145627a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248b8da63e634c2f8c52ada62001338d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:35:02Z,use_quota=True,user_id='ecb05c1834da450fa82b5fb1a058c81a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e926d73d-279a-43dc-94dc-65641cc3a6ed tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8873244-c4cc-4e38-a87c-093e5cfccf7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e926d73d-279a-43dc-94dc-65641cc3a6ed tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8873244-c4cc-4e38-a87c-093e5cfccf7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e926d73d-279a-43dc-94dc-65641cc3a6ed tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad656ea-bfa6-4b3c-813b-8dfae25c4c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e926d73d-279a-43dc-94dc-65641cc3a6ed tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad656ea-bfa6-4b3c-813b-8dfae25c4c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32404c33-06c9-4362-b3ce-402d145627a1', 'volume_name': 'volume-32404c33-06c9-4362-b3ce-402d145627a1', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e926d73d-279a-43dc-94dc-65641cc3a6ed tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (454a7257-9b76-4094-b391-8ac04779d321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:01 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e926d73d-279a-43dc-94dc-65641cc3a6ed tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (454a7257-9b76-4094-b391-8ac04779d321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e926d73d-279a-43dc-94dc-65641cc3a6ed tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d34bd12e-03a9-4e49-b7d2-fe243ff48647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:01 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-e926d73d-279a-43dc-94dc-65641cc3a6ed tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Volume 32404c33-06c9-4362-b3ce-402d145627a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32404c33-06c9-4362-b3ce-402d145627a1', 'volume_size': 1}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e926d73d-279a-43dc-94dc-65641cc3a6ed tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-01d837e0-4915-4248-a386-0a4280bcb0fd tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.532s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-01d837e0-4915-4248-a386-0a4280bcb0fd tempest-CreateVolumesFromSnapshotTest-389980398 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:35:01 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-01d837e0-4915-4248-a386-0a4280bcb0fd tempest-CreateVolumesFromSnapshotTest-389980398 None] Deleted volume successfully.
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-01d837e0-4915-4248-a386-0a4280bcb0fd tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "cinder-34c8b1fe-4417-4843-8e7c-e5beff9bb3a0-delete_volume" released by "delete_volume" :: held 1.940s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-7ecb1e1c-c814-4e35-8b1b-c4a5046e613a tempest-VolumeDependencyTests-1466340 None] Created reservations ['ae59ad34-53a2-4870-9864-ef77a3a3bd65', '033b98af-3909-4790-a9f1-f87f62eb8219', '51a9fac3-19f2-4bf7-916c-1b5893f3420c', '4f87b41b-be66-4ac1-94ef-846fdf3d0860'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:35:01 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-7ecb1e1c-c814-4e35-8b1b-c4a5046e613a tempest-VolumeDependencyTests-1466340 None] Delete snapshot completed successfully.
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-7ecb1e1c-c814-4e35-8b1b-c4a5046e613a tempest-VolumeDependencyTests-1466340 None] Lock "cinder-d31db937-6e4c-456b-8967-94d7f696268c-delete_snapshot" released by "delete_snapshot" :: held 2.669s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-7d5c0d9d-2317-4638-b44d-d8c17fe5d75e tempest-CreateVolumesFromSnapshotTest-389980398 None] Acquiring lock "cinder-8aec8915-3aee-44a5-aa50-389469d46121-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-7d5c0d9d-2317-4638-b44d-d8c17fe5d75e tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "cinder-8aec8915-3aee-44a5-aa50-389469d46121-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-7d5c0d9d-2317-4638-b44d-d8c17fe5d75e tempest-CreateVolumesFromSnapshotTest-389980398 None] Acquiring lock "cinder-quobyte-8aec8915-3aee-44a5-aa50-389469d46121" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:01 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-7d5c0d9d-2317-4638-b44d-d8c17fe5d75e tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "cinder-quobyte-8aec8915-3aee-44a5-aa50-389469d46121" acquired by "delete_volume" :: waited 0.007s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:02 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce98d60-f848-4d5a-8475-44cd74d03dd6]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:35:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7d5c0d9d-2317-4638-b44d-d8c17fe5d75e tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8aec8915-3aee-44a5-aa50-389469d46121 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:02 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-70d8ffb6-482c-4bf6-bfd3-b9d3ddec6906 tempest-SnapshotDependencyTests-1378294697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3219e7c-4a2a-4201-b860-13d416841808 -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808.8b3640d3-cd51-48f2-9d70-db5eaeff9a44" returned: 0 in 0.479s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:02 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-70d8ffb6-482c-4bf6-bfd3-b9d3ddec6906 tempest-SnapshotDependencyTests-1378294697 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808.8b3640d3-cd51-48f2-9d70-db5eaeff9a44 is being set with open permissions: ugo+rw
Apr 02 10:35:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-70d8ffb6-482c-4bf6-bfd3-b9d3ddec6906 tempest-SnapshotDependencyTests-1378294697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808.8b3640d3-cd51-48f2-9d70-db5eaeff9a44 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:02 devstack sudo[90188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808.8b3640d3-cd51-48f2-9d70-db5eaeff9a44
Apr 02 10:35:02 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:02 devstack sudo[90187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8aec8915-3aee-44a5-aa50-389469d46121
Apr 02 10:35:02 devstack sudo[90187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:02 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-0b62f0a8-a97c-49e7-b8f2-74ea6433aa20 tempest-VolumeDependencyTests-1466340 None] Acquiring lock "cinder-969474f1-5ffe-4167-8ae9-a9354bcca1d4-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:02 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-0b62f0a8-a97c-49e7-b8f2-74ea6433aa20 tempest-VolumeDependencyTests-1466340 None] Lock "cinder-969474f1-5ffe-4167-8ae9-a9354bcca1d4-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:02 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-0b62f0a8-a97c-49e7-b8f2-74ea6433aa20 tempest-VolumeDependencyTests-1466340 None] Acquiring lock "cinder-quobyte-969474f1-5ffe-4167-8ae9-a9354bcca1d4" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:02 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-0b62f0a8-a97c-49e7-b8f2-74ea6433aa20 tempest-VolumeDependencyTests-1466340 None] Lock "cinder-quobyte-969474f1-5ffe-4167-8ae9-a9354bcca1d4" acquired by "delete_volume" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:02 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d4919e-843a-40c8-93c3-96b0ee18fc9a]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:35:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0b62f0a8-a97c-49e7-b8f2-74ea6433aa20 tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:02 devstack sudo[90191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4
Apr 02 10:35:02 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:02 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-70d8ffb6-482c-4bf6-bfd3-b9d3ddec6906 tempest-SnapshotDependencyTests-1378294697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808.8b3640d3-cd51-48f2-9d70-db5eaeff9a44" returned: 0 in 0.400s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-70d8ffb6-482c-4bf6-bfd3-b9d3ddec6906 tempest-SnapshotDependencyTests-1378294697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:02 devstack sudo[90197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808.info
Apr 02 10:35:02 devstack sudo[90197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:02 devstack sudo[90187]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7d5c0d9d-2317-4638-b44d-d8c17fe5d75e tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8aec8915-3aee-44a5-aa50-389469d46121" returned: 0 in 0.495s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7d5c0d9d-2317-4638-b44d-d8c17fe5d75e tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8aec8915-3aee-44a5-aa50-389469d46121 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:02 devstack sudo[90199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8aec8915-3aee-44a5-aa50-389469d46121
Apr 02 10:35:02 devstack sudo[90199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:02 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0b62f0a8-a97c-49e7-b8f2-74ea6433aa20 tempest-VolumeDependencyTests-1466340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4" returned: 0 in 0.479s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0b62f0a8-a97c-49e7-b8f2-74ea6433aa20 tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:02 devstack sudo[90204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4
Apr 02 10:35:02 devstack sudo[90204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:02 devstack sudo[90197]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-70d8ffb6-482c-4bf6-bfd3-b9d3ddec6906 tempest-SnapshotDependencyTests-1378294697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808.info" returned: 0 in 0.428s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:02 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-70d8ffb6-482c-4bf6-bfd3-b9d3ddec6906 tempest-SnapshotDependencyTests-1378294697 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808.info is being set with open permissions: ugo+rw
Apr 02 10:35:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-70d8ffb6-482c-4bf6-bfd3-b9d3ddec6906 tempest-SnapshotDependencyTests-1378294697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:02 devstack sudo[90208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808.info
Apr 02 10:35:02 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:02 devstack sudo[90199]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7d5c0d9d-2317-4638-b44d-d8c17fe5d75e tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8aec8915-3aee-44a5-aa50-389469d46121" returned: 0 in 0.413s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:02 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-7d5c0d9d-2317-4638-b44d-d8c17fe5d75e tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "cinder-quobyte-8aec8915-3aee-44a5-aa50-389469d46121" released by "delete_volume" :: held 0.939s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:02 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-7d5c0d9d-2317-4638-b44d-d8c17fe5d75e tempest-CreateVolumesFromSnapshotTest-389980398 None] Created reservations ['170cde62-10e3-45a1-bedd-a78c0aca3972', '7877171d-ec7e-48bf-9c12-6ce91619fba7', '29bd2b64-ea79-48f6-8975-5f7aa0668eb8', '147b9c30-c767-41b5-98b9-9cd39e873559'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:35:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-7d5c0d9d-2317-4638-b44d-d8c17fe5d75e tempest-CreateVolumesFromSnapshotTest-389980398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-7d5c0d9d-2317-4638-b44d-d8c17fe5d75e tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:02 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-7d5c0d9d-2317-4638-b44d-d8c17fe5d75e tempest-CreateVolumesFromSnapshotTest-389980398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:35:02 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-7d5c0d9d-2317-4638-b44d-d8c17fe5d75e tempest-CreateVolumesFromSnapshotTest-389980398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:35:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-7d5c0d9d-2317-4638-b44d-d8c17fe5d75e tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:02 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7d5c0d9d-2317-4638-b44d-d8c17fe5d75e tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:03 devstack sudo[90210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:35:03 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9a73c04a-d552-48cb-a172-b7d63e698b78 tempest-CreateVolumesFromSnapshotTest-389980398 None] Acquiring lock "cinder-d01f3b11-a010-4e7e-8b41-8d2f9347cd65-delete_snapshot" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9a73c04a-d552-48cb-a172-b7d63e698b78 tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "cinder-d01f3b11-a010-4e7e-8b41-8d2f9347cd65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9a73c04a-d552-48cb-a172-b7d63e698b78 tempest-CreateVolumesFromSnapshotTest-389980398 None] Acquiring lock "cinder-quobyte-8eca8bd5-c14a-46bd-8629-0b649acd773f" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9a73c04a-d552-48cb-a172-b7d63e698b78 tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "cinder-quobyte-8eca8bd5-c14a-46bd-8629-0b649acd773f" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9a73c04a-d552-48cb-a172-b7d63e698b78 tempest-CreateVolumesFromSnapshotTest-389980398 None] Acquiring lock "cinder-quobyte-d01f3b11-a010-4e7e-8b41-8d2f9347cd65" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9a73c04a-d552-48cb-a172-b7d63e698b78 tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "cinder-quobyte-d01f3b11-a010-4e7e-8b41-8d2f9347cd65" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-9a73c04a-d552-48cb-a172-b7d63e698b78 tempest-CreateVolumesFromSnapshotTest-389980398 None] Deleting offline snapshot d01f3b11-a010-4e7e-8b41-8d2f9347cd65 of volume 8eca8bd5-c14a-46bd-8629-0b649acd773f {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-9a73c04a-d552-48cb-a172-b7d63e698b78 tempest-CreateVolumesFromSnapshotTest-389980398 None] snapshot_file for this snap is: volume-8eca8bd5-c14a-46bd-8629-0b649acd773f.d01f3b11-a010-4e7e-8b41-8d2f9347cd65 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8601af-da6b-4cb7-a233-0666a9323021]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9a73c04a-d552-48cb-a172-b7d63e698b78 tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f.d01f3b11-a010-4e7e-8b41-8d2f9347cd65 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:03 devstack sudo[90204]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0b62f0a8-a97c-49e7-b8f2-74ea6433aa20 tempest-VolumeDependencyTests-1466340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-969474f1-5ffe-4167-8ae9-a9354bcca1d4" returned: 0 in 0.416s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-0b62f0a8-a97c-49e7-b8f2-74ea6433aa20 tempest-VolumeDependencyTests-1466340 None] Lock "cinder-quobyte-969474f1-5ffe-4167-8ae9-a9354bcca1d4" released by "delete_volume" :: held 0.923s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:03 devstack sudo[90213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f.d01f3b11-a010-4e7e-8b41-8d2f9347cd65
Apr 02 10:35:03 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-0b62f0a8-a97c-49e7-b8f2-74ea6433aa20 tempest-VolumeDependencyTests-1466340 None] Created reservations ['39045b40-c05f-4a6a-b4b4-bbdf89328e9e', 'ffaf0762-ad65-47e2-995f-b2e88be2d4e8', '778676ec-fac6-4159-90f4-fb2b3fee60d0', 'fa87e015-eacf-4a80-ad8b-fd4fbd24f5f7'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-0b62f0a8-a97c-49e7-b8f2-74ea6433aa20 tempest-VolumeDependencyTests-1466340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-0b62f0a8-a97c-49e7-b8f2-74ea6433aa20 tempest-VolumeDependencyTests-1466340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-0b62f0a8-a97c-49e7-b8f2-74ea6433aa20 tempest-VolumeDependencyTests-1466340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-0b62f0a8-a97c-49e7-b8f2-74ea6433aa20 tempest-VolumeDependencyTests-1466340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-0b62f0a8-a97c-49e7-b8f2-74ea6433aa20 tempest-VolumeDependencyTests-1466340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0b62f0a8-a97c-49e7-b8f2-74ea6433aa20 tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:03 devstack sudo[90216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:35:03 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:03 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-70d8ffb6-482c-4bf6-bfd3-b9d3ddec6906 tempest-SnapshotDependencyTests-1378294697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808.info" returned: 0 in 0.471s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-70d8ffb6-482c-4bf6-bfd3-b9d3ddec6906 tempest-SnapshotDependencyTests-1378294697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.125s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-23b3b2e2-c562-490c-b3eb-2184533a0f65 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.501s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-23b3b2e2-c562-490c-b3eb-2184533a0f65 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-425160777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a1dadd0-5c92-4917-ae8f-15528be072f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248b8da63e634c2f8c52ada62001338d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:35:01Z,use_quota=True,user_id='ecb05c1834da450fa82b5fb1a058c81a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-23b3b2e2-c562-490c-b3eb-2184533a0f65 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Creating volume 4a1dadd0-5c92-4917-ae8f-15528be072f3 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-23b3b2e2-c562-490c-b3eb-2184533a0f65 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-23b3b2e2-c562-490c-b3eb-2184533a0f65 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-23b3b2e2-c562-490c-b3eb-2184533a0f65 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-23b3b2e2-c562-490c-b3eb-2184533a0f65 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-23b3b2e2-c562-490c-b3eb-2184533a0f65 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-23b3b2e2-c562-490c-b3eb-2184533a0f65 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:35:03 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-23b3b2e2-c562-490c-b3eb-2184533a0f65 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-23b3b2e2-c562-490c-b3eb-2184533a0f65 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4a1dadd0-5c92-4917-ae8f-15528be072f3 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:03 devstack sudo[90218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4a1dadd0-5c92-4917-ae8f-15528be072f3 1073741824
Apr 02 10:35:03 devstack sudo[90218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:03 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-70d8ffb6-482c-4bf6-bfd3-b9d3ddec6906 tempest-SnapshotDependencyTests-1378294697 None] Create snapshot completed successfully
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-d59d383a-35ea-4202-b8c1-7ba4aad4004a tempest-VolumeDependencyTests-1466340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:35:03 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d59d383a-35ea-4202-b8c1-7ba4aad4004a tempest-VolumeDependencyTests-1466340 None] Flow 'volume_create_manager' (21b98de2-861d-4cc3-9f92-eec12c99cd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d59d383a-35ea-4202-b8c1-7ba4aad4004a tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5debb40f-f5fd-4d73-9f1b-6aa86be9ff95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-7d5c0d9d-2317-4638-b44d-d8c17fe5d75e tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.690s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-7d5c0d9d-2317-4638-b44d-d8c17fe5d75e tempest-CreateVolumesFromSnapshotTest-389980398 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:35:03 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-7d5c0d9d-2317-4638-b44d-d8c17fe5d75e tempest-CreateVolumesFromSnapshotTest-389980398 None] Deleted volume successfully.
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d59d383a-35ea-4202-b8c1-7ba4aad4004a tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5debb40f-f5fd-4d73-9f1b-6aa86be9ff95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-496380052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d07869-e4ba-47d2-acfb-8311a459f59e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e1353b5f6e343c0896535424f8300ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:35:04Z,use_quota=True,user_id='afea7cd197ef4f3c9f4a091988c19f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d59d383a-35ea-4202-b8c1-7ba4aad4004a tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ac2d29-d05d-46f6-9662-a55a29a3dd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d59d383a-35ea-4202-b8c1-7ba4aad4004a tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ac2d29-d05d-46f6-9662-a55a29a3dd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d59d383a-35ea-4202-b8c1-7ba4aad4004a tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fc8efad-4be4-416f-97c1-27bda4c0de86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d59d383a-35ea-4202-b8c1-7ba4aad4004a tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fc8efad-4be4-416f-97c1-27bda4c0de86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33d07869-e4ba-47d2-acfb-8311a459f59e', 'volume_name': 'volume-33d07869-e4ba-47d2-acfb-8311a459f59e', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d59d383a-35ea-4202-b8c1-7ba4aad4004a tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (597e8dcd-647b-48ea-bf4e-1e7884d2f0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d59d383a-35ea-4202-b8c1-7ba4aad4004a tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (597e8dcd-647b-48ea-bf4e-1e7884d2f0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:03 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d59d383a-35ea-4202-b8c1-7ba4aad4004a tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3958a8b7-51e8-465a-8351-02268a43418a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:03 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-d59d383a-35ea-4202-b8c1-7ba4aad4004a tempest-VolumeDependencyTests-1466340 None] Volume 33d07869-e4ba-47d2-acfb-8311a459f59e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33d07869-e4ba-47d2-acfb-8311a459f59e', 'volume_size': 1}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d59d383a-35ea-4202-b8c1-7ba4aad4004a tempest-VolumeDependencyTests-1466340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9a73c04a-d552-48cb-a172-b7d63e698b78 tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f.d01f3b11-a010-4e7e-8b41-8d2f9347cd65" returned: 0 in 0.603s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-9a73c04a-d552-48cb-a172-b7d63e698b78 tempest-CreateVolumesFromSnapshotTest-389980398 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8eca8bd5-c14a-46bd-8629-0b649acd773f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-7d5c0d9d-2317-4638-b44d-d8c17fe5d75e tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "cinder-8aec8915-3aee-44a5-aa50-389469d46121-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d7f62d-4b82-4483-9478-6913e48691ce]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9a73c04a-d552-48cb-a172-b7d63e698b78 tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:03 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-0b62f0a8-a97c-49e7-b8f2-74ea6433aa20 tempest-VolumeDependencyTests-1466340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.516s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-0b62f0a8-a97c-49e7-b8f2-74ea6433aa20 tempest-VolumeDependencyTests-1466340 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:35:03 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-0b62f0a8-a97c-49e7-b8f2-74ea6433aa20 tempest-VolumeDependencyTests-1466340 None] Deleted volume successfully.
Apr 02 10:35:03 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-0b62f0a8-a97c-49e7-b8f2-74ea6433aa20 tempest-VolumeDependencyTests-1466340 None] Lock "cinder-969474f1-5ffe-4167-8ae9-a9354bcca1d4-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:03 devstack sudo[90225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f
Apr 02 10:35:03 devstack sudo[90225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:04 devstack sudo[90218]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-23b3b2e2-c562-490c-b3eb-2184533a0f65 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4a1dadd0-5c92-4917-ae8f-15528be072f3 1073741824" returned: 0 in 0.648s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-23b3b2e2-c562-490c-b3eb-2184533a0f65 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4a1dadd0-5c92-4917-ae8f-15528be072f3 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:04 devstack sudo[90230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4a1dadd0-5c92-4917-ae8f-15528be072f3
Apr 02 10:35:04 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:04 devstack sudo[90225]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9a73c04a-d552-48cb-a172-b7d63e698b78 tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f" returned: 0 in 0.500s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9a73c04a-d552-48cb-a172-b7d63e698b78 tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f.d01f3b11-a010-4e7e-8b41-8d2f9347cd65 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:04 devstack sudo[90235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f.d01f3b11-a010-4e7e-8b41-8d2f9347cd65
Apr 02 10:35:04 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:04 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-23b3b2e2-c562-490c-b3eb-2184533a0f65 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4a1dadd0-5c92-4917-ae8f-15528be072f3" returned: 0 in 0.459s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:04 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-23b3b2e2-c562-490c-b3eb-2184533a0f65 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:35:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-23b3b2e2-c562-490c-b3eb-2184533a0f65 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-95e7a1d6-9001-4c6a-bbb8-51afafc277c4 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.411s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:04 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-95e7a1d6-9001-4c6a-bbb8-51afafc277c4 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-535469776',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=816eea4d-0717-47d5-bee7-6794d3de2fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248b8da63e634c2f8c52ada62001338d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:35:01Z,use_quota=True,user_id='ecb05c1834da450fa82b5fb1a058c81a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:35:04 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-95e7a1d6-9001-4c6a-bbb8-51afafc277c4 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Creating volume 816eea4d-0717-47d5-bee7-6794d3de2fe8 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:35:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-95e7a1d6-9001-4c6a-bbb8-51afafc277c4 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-95e7a1d6-9001-4c6a-bbb8-51afafc277c4 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:04 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-95e7a1d6-9001-4c6a-bbb8-51afafc277c4 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:35:04 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-95e7a1d6-9001-4c6a-bbb8-51afafc277c4 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:35:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-95e7a1d6-9001-4c6a-bbb8-51afafc277c4 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:04 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-95e7a1d6-9001-4c6a-bbb8-51afafc277c4 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:35:04 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-95e7a1d6-9001-4c6a-bbb8-51afafc277c4 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:35:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-95e7a1d6-9001-4c6a-bbb8-51afafc277c4 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-816eea4d-0717-47d5-bee7-6794d3de2fe8 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-23b3b2e2-c562-490c-b3eb-2184533a0f65 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf15b60-30cf-481b-bd31-43e8584801bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a1dadd0-5c92-4917-ae8f-15528be072f3', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-23b3b2e2-c562-490c-b3eb-2184533a0f65 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab3fb302-67f3-4f93-8cc2-3a0710a996ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:04 devstack sudo[90238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-816eea4d-0717-47d5-bee7-6794d3de2fe8 1073741824
Apr 02 10:35:04 devstack sudo[90238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:04 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-23b3b2e2-c562-490c-b3eb-2184533a0f65 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Volume volume-4a1dadd0-5c92-4917-ae8f-15528be072f3 (4a1dadd0-5c92-4917-ae8f-15528be072f3): created successfully
Apr 02 10:35:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-23b3b2e2-c562-490c-b3eb-2184533a0f65 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab3fb302-67f3-4f93-8cc2-3a0710a996ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-23b3b2e2-c562-490c-b3eb-2184533a0f65 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Flow 'volume_create_manager' (9673824c-26e4-4816-8f61-ca6446fbc2c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:35:04 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-23b3b2e2-c562-490c-b3eb-2184533a0f65 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Created volume successfully.
Apr 02 10:35:04 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:35:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Flow 'volume_create_manager' (55d594f7-5f14-4a43-870b-d5872af4aad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:35:04 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8abccb01-6506-4e39-b8fd-9b0443c8c3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9a73c04a-d552-48cb-a172-b7d63e698b78 tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f.d01f3b11-a010-4e7e-8b41-8d2f9347cd65" returned: 0 in 0.584s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9a73c04a-d552-48cb-a172-b7d63e698b78 tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f.d01f3b11-a010-4e7e-8b41-8d2f9347cd65 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8abccb01-6506-4e39-b8fd-9b0443c8c3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3bfe145-1ec3-49ac-9195-6f28a813c770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ce0288e3a504e1184f345b0f2c613d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8b3640d3-cd51-48f2-9d70-db5eaeff9a44,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:35:05Z,use_quota=True,user_id='6a217c4bec2f455b87f5bbaef1061824',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:04 devstack sudo[90243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f.d01f3b11-a010-4e7e-8b41-8d2f9347cd65
Apr 02 10:35:04 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edeb9b77-eda2-404b-9150-8e0517124c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edeb9b77-eda2-404b-9150-8e0517124c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (954cee79-737e-43d6-beb0-1fd615f08135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (954cee79-737e-43d6-beb0-1fd615f08135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd3bfe145-1ec3-49ac-9195-6f28a813c770', 'volume_name': 'volume-d3bfe145-1ec3-49ac-9195-6f28a813c770', 'volume_size': 1, 'snapshot_id': '8b3640d3-cd51-48f2-9d70-db5eaeff9a44'}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a321ba4d-697b-44b9-8315-dba70ec6561b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a321ba4d-697b-44b9-8315-dba70ec6561b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:04 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b69ef36-8f85-4257-85d4-1a7d3f74bc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:04 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Volume d3bfe145-1ec3-49ac-9195-6f28a813c770: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d3bfe145-1ec3-49ac-9195-6f28a813c770', 'volume_size': 1, 'snapshot_id': '8b3640d3-cd51-48f2-9d70-db5eaeff9a44'}
Apr 02 10:35:04 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:05 devstack sudo[90238]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-95e7a1d6-9001-4c6a-bbb8-51afafc277c4 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-816eea4d-0717-47d5-bee7-6794d3de2fe8 1073741824" returned: 0 in 0.540s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-95e7a1d6-9001-4c6a-bbb8-51afafc277c4 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-816eea4d-0717-47d5-bee7-6794d3de2fe8 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:05 devstack sudo[90248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-816eea4d-0717-47d5-bee7-6794d3de2fe8
Apr 02 10:35:05 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:05 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9a73c04a-d552-48cb-a172-b7d63e698b78 tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f.d01f3b11-a010-4e7e-8b41-8d2f9347cd65" returned: 0 in 0.445s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:05 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9a73c04a-d552-48cb-a172-b7d63e698b78 tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "cinder-quobyte-d01f3b11-a010-4e7e-8b41-8d2f9347cd65" released by "_delete_snapshot" :: held 2.200s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:05 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9a73c04a-d552-48cb-a172-b7d63e698b78 tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "cinder-quobyte-8eca8bd5-c14a-46bd-8629-0b649acd773f" released by "delete_snapshot" :: held 2.217s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:05 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-9a73c04a-d552-48cb-a172-b7d63e698b78 tempest-CreateVolumesFromSnapshotTest-389980398 None] Created reservations ['d98ddec3-d07c-45db-b328-ef90a6a4af7f', '5b1fd6fe-3991-4c0a-b497-457bc6dc439e', '932d28d5-6e25-4cc3-9646-338bf0895540', 'c49f75d4-e043-4a06-bf36-3f52b245c21e'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:35:05 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-9a73c04a-d552-48cb-a172-b7d63e698b78 tempest-CreateVolumesFromSnapshotTest-389980398 None] Delete snapshot completed successfully.
Apr 02 10:35:05 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9a73c04a-d552-48cb-a172-b7d63e698b78 tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "cinder-d01f3b11-a010-4e7e-8b41-8d2f9347cd65-delete_snapshot" released by "delete_snapshot" :: held 2.324s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:05 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-95e7a1d6-9001-4c6a-bbb8-51afafc277c4 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-816eea4d-0717-47d5-bee7-6794d3de2fe8" returned: 0 in 0.448s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:05 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-95e7a1d6-9001-4c6a-bbb8-51afafc277c4 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:35:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-95e7a1d6-9001-4c6a-bbb8-51afafc277c4 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-08810666-95a2-434b-bfd4-6f47b7cb4e37 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.230s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:05 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-08810666-95a2-434b-bfd4-6f47b7cb4e37 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1906596528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3e6d57-b40f-4aa2-a974-37c7d0b7ee00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248b8da63e634c2f8c52ada62001338d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:35:01Z,use_quota=True,user_id='ecb05c1834da450fa82b5fb1a058c81a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:35:05 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-08810666-95a2-434b-bfd4-6f47b7cb4e37 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Creating volume ee3e6d57-b40f-4aa2-a974-37c7d0b7ee00 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:35:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-08810666-95a2-434b-bfd4-6f47b7cb4e37 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-08810666-95a2-434b-bfd4-6f47b7cb4e37 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:05 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-08810666-95a2-434b-bfd4-6f47b7cb4e37 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:35:05 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-08810666-95a2-434b-bfd4-6f47b7cb4e37 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:35:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-08810666-95a2-434b-bfd4-6f47b7cb4e37 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:05 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-08810666-95a2-434b-bfd4-6f47b7cb4e37 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:35:05 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-08810666-95a2-434b-bfd4-6f47b7cb4e37 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:35:05 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-08810666-95a2-434b-bfd4-6f47b7cb4e37 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-ee3e6d57-b40f-4aa2-a974-37c7d0b7ee00 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:05 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-95e7a1d6-9001-4c6a-bbb8-51afafc277c4 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad711e1-2433-466a-a57f-091d6d42122c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-816eea4d-0717-47d5-bee7-6794d3de2fe8', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:05 devstack sudo[90252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-ee3e6d57-b40f-4aa2-a974-37c7d0b7ee00 1073741824
Apr 02 10:35:05 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-95e7a1d6-9001-4c6a-bbb8-51afafc277c4 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (946cc57b-5a8e-4eb3-8013-1cf0cdb18f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:05 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:05 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-95e7a1d6-9001-4c6a-bbb8-51afafc277c4 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Volume volume-816eea4d-0717-47d5-bee7-6794d3de2fe8 (816eea4d-0717-47d5-bee7-6794d3de2fe8): created successfully
Apr 02 10:35:05 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-95e7a1d6-9001-4c6a-bbb8-51afafc277c4 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (946cc57b-5a8e-4eb3-8013-1cf0cdb18f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:05 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-95e7a1d6-9001-4c6a-bbb8-51afafc277c4 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Flow 'volume_create_manager' (4af6aff1-2952-4515-ae47-3cb22a2d67dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:35:05 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-95e7a1d6-9001-4c6a-bbb8-51afafc277c4 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Created volume successfully.
Apr 02 10:35:06 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-08810666-95a2-434b-bfd4-6f47b7cb4e37 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-ee3e6d57-b40f-4aa2-a974-37c7d0b7ee00 1073741824" returned: 0 in 0.506s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-08810666-95a2-434b-bfd4-6f47b7cb4e37 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-ee3e6d57-b40f-4aa2-a974-37c7d0b7ee00 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:06 devstack sudo[90257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-ee3e6d57-b40f-4aa2-a974-37c7d0b7ee00
Apr 02 10:35:06 devstack sudo[90257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:06 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5e24724b-1715-4ecb-9de4-e3f6f42f1ddf tempest-CreateVolumesFromSnapshotTest-389980398 None] Acquiring lock "cinder-8eca8bd5-c14a-46bd-8629-0b649acd773f-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:06 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5e24724b-1715-4ecb-9de4-e3f6f42f1ddf tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "cinder-8eca8bd5-c14a-46bd-8629-0b649acd773f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:06 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5e24724b-1715-4ecb-9de4-e3f6f42f1ddf tempest-CreateVolumesFromSnapshotTest-389980398 None] Acquiring lock "cinder-quobyte-8eca8bd5-c14a-46bd-8629-0b649acd773f" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:06 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5e24724b-1715-4ecb-9de4-e3f6f42f1ddf tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "cinder-quobyte-8eca8bd5-c14a-46bd-8629-0b649acd773f" acquired by "delete_volume" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:06 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6064f71-42ca-47d1-b476-cd1ec950c697]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:35:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5e24724b-1715-4ecb-9de4-e3f6f42f1ddf tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:06 devstack sudo[90259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f
Apr 02 10:35:06 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:06 devstack sudo[90257]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-08810666-95a2-434b-bfd4-6f47b7cb4e37 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-ee3e6d57-b40f-4aa2-a974-37c7d0b7ee00" returned: 0 in 0.408s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:06 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-08810666-95a2-434b-bfd4-6f47b7cb4e37 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:35:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-08810666-95a2-434b-bfd4-6f47b7cb4e37 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-499ba04f-1cbc-4c92-a104-b21561484923 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.953s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:06 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-499ba04f-1cbc-4c92-a104-b21561484923 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-852570667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36ee8c1a-4900-434b-be0d-83e9eb870164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248b8da63e634c2f8c52ada62001338d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:35:01Z,use_quota=True,user_id='ecb05c1834da450fa82b5fb1a058c81a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:35:06 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-499ba04f-1cbc-4c92-a104-b21561484923 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Creating volume 36ee8c1a-4900-434b-be0d-83e9eb870164 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:35:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-499ba04f-1cbc-4c92-a104-b21561484923 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-499ba04f-1cbc-4c92-a104-b21561484923 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:06 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-499ba04f-1cbc-4c92-a104-b21561484923 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:35:06 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-499ba04f-1cbc-4c92-a104-b21561484923 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:35:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-499ba04f-1cbc-4c92-a104-b21561484923 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:06 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-499ba04f-1cbc-4c92-a104-b21561484923 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:35:06 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-499ba04f-1cbc-4c92-a104-b21561484923 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:35:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-499ba04f-1cbc-4c92-a104-b21561484923 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-36ee8c1a-4900-434b-be0d-83e9eb870164 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:06 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-08810666-95a2-434b-bfd4-6f47b7cb4e37 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab300264-4e77-4f54-a445-ba4be65d85ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee3e6d57-b40f-4aa2-a974-37c7d0b7ee00', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:06 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-08810666-95a2-434b-bfd4-6f47b7cb4e37 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9480869d-63fa-4cde-a2d0-9b6b91722d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:06 devstack sudo[90262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-36ee8c1a-4900-434b-be0d-83e9eb870164 1073741824
Apr 02 10:35:06 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:06 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-08810666-95a2-434b-bfd4-6f47b7cb4e37 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Volume volume-ee3e6d57-b40f-4aa2-a974-37c7d0b7ee00 (ee3e6d57-b40f-4aa2-a974-37c7d0b7ee00): created successfully
Apr 02 10:35:06 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-08810666-95a2-434b-bfd4-6f47b7cb4e37 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9480869d-63fa-4cde-a2d0-9b6b91722d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:06 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-08810666-95a2-434b-bfd4-6f47b7cb4e37 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Flow 'volume_create_manager' (9f925054-4be6-4e2c-977b-8ad5f4337f2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:35:06 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-08810666-95a2-434b-bfd4-6f47b7cb4e37 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Created volume successfully.
Apr 02 10:35:06 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5e24724b-1715-4ecb-9de4-e3f6f42f1ddf tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f" returned: 0 in 0.511s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:06 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5e24724b-1715-4ecb-9de4-e3f6f42f1ddf tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:06 devstack sudo[90267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f
Apr 02 10:35:06 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:07 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-499ba04f-1cbc-4c92-a104-b21561484923 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-36ee8c1a-4900-434b-be0d-83e9eb870164 1073741824" returned: 0 in 0.507s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-499ba04f-1cbc-4c92-a104-b21561484923 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-36ee8c1a-4900-434b-be0d-83e9eb870164 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:07 devstack sudo[90272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-36ee8c1a-4900-434b-be0d-83e9eb870164
Apr 02 10:35:07 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:07 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5e24724b-1715-4ecb-9de4-e3f6f42f1ddf tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8eca8bd5-c14a-46bd-8629-0b649acd773f" returned: 0 in 0.429s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:07 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5e24724b-1715-4ecb-9de4-e3f6f42f1ddf tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "cinder-quobyte-8eca8bd5-c14a-46bd-8629-0b649acd773f" released by "delete_volume" :: held 0.976s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:07 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-5e24724b-1715-4ecb-9de4-e3f6f42f1ddf tempest-CreateVolumesFromSnapshotTest-389980398 None] Created reservations ['d9ade0aa-7f6b-480f-ac00-1cead269a59e', '6f6c9dfa-949c-45d6-a42f-961b315b638f', '6e13ae67-c734-477e-986c-e00440ad0cf4', 'b25f2cc4-2fbd-4480-8953-6b1806f9b4a7'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:35:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5e24724b-1715-4ecb-9de4-e3f6f42f1ddf tempest-CreateVolumesFromSnapshotTest-389980398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5e24724b-1715-4ecb-9de4-e3f6f42f1ddf tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:07 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5e24724b-1715-4ecb-9de4-e3f6f42f1ddf tempest-CreateVolumesFromSnapshotTest-389980398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:35:07 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-5e24724b-1715-4ecb-9de4-e3f6f42f1ddf tempest-CreateVolumesFromSnapshotTest-389980398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:35:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-5e24724b-1715-4ecb-9de4-e3f6f42f1ddf tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5e24724b-1715-4ecb-9de4-e3f6f42f1ddf tempest-CreateVolumesFromSnapshotTest-389980398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:07 devstack sudo[90275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:35:07 devstack sudo[90275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:07 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-499ba04f-1cbc-4c92-a104-b21561484923 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-36ee8c1a-4900-434b-be0d-83e9eb870164" returned: 0 in 0.413s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:07 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-499ba04f-1cbc-4c92-a104-b21561484923 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:35:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-499ba04f-1cbc-4c92-a104-b21561484923 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e926d73d-279a-43dc-94dc-65641cc3a6ed tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.791s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:07 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e926d73d-279a-43dc-94dc-65641cc3a6ed tempest-CreateVolumesFromSourceVolumeTest-273309328 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-668491870',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32404c33-06c9-4362-b3ce-402d145627a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248b8da63e634c2f8c52ada62001338d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:35:02Z,use_quota=True,user_id='ecb05c1834da450fa82b5fb1a058c81a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:35:07 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-e926d73d-279a-43dc-94dc-65641cc3a6ed tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Creating volume 32404c33-06c9-4362-b3ce-402d145627a1 {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:35:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e926d73d-279a-43dc-94dc-65641cc3a6ed tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e926d73d-279a-43dc-94dc-65641cc3a6ed tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:07 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e926d73d-279a-43dc-94dc-65641cc3a6ed tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:35:07 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e926d73d-279a-43dc-94dc-65641cc3a6ed tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:35:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e926d73d-279a-43dc-94dc-65641cc3a6ed tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:07 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e926d73d-279a-43dc-94dc-65641cc3a6ed tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:35:07 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-e926d73d-279a-43dc-94dc-65641cc3a6ed tempest-CreateVolumesFromSourceVolumeTest-273309328 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:35:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e926d73d-279a-43dc-94dc-65641cc3a6ed tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-32404c33-06c9-4362-b3ce-402d145627a1 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:07 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-499ba04f-1cbc-4c92-a104-b21561484923 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd16830-d238-4f06-81f6-cbe505ad6a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36ee8c1a-4900-434b-be0d-83e9eb870164', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:07 devstack sudo[90278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-32404c33-06c9-4362-b3ce-402d145627a1 1073741824
Apr 02 10:35:07 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:07 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-499ba04f-1cbc-4c92-a104-b21561484923 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd27198-7baf-4f7d-9239-3c2e4f477a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:07 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-499ba04f-1cbc-4c92-a104-b21561484923 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Volume volume-36ee8c1a-4900-434b-be0d-83e9eb870164 (36ee8c1a-4900-434b-be0d-83e9eb870164): created successfully
Apr 02 10:35:07 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-499ba04f-1cbc-4c92-a104-b21561484923 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd27198-7baf-4f7d-9239-3c2e4f477a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:07 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-499ba04f-1cbc-4c92-a104-b21561484923 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Flow 'volume_create_manager' (6b826227-0d7e-49e9-b59f-d5628f44b9ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:35:07 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-499ba04f-1cbc-4c92-a104-b21561484923 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Created volume successfully.
Apr 02 10:35:07 devstack sudo[90275]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-5e24724b-1715-4ecb-9de4-e3f6f42f1ddf tempest-CreateVolumesFromSnapshotTest-389980398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.400s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:07 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-5e24724b-1715-4ecb-9de4-e3f6f42f1ddf tempest-CreateVolumesFromSnapshotTest-389980398 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:35:07 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-5e24724b-1715-4ecb-9de4-e3f6f42f1ddf tempest-CreateVolumesFromSnapshotTest-389980398 None] Deleted volume successfully.
Apr 02 10:35:07 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-5e24724b-1715-4ecb-9de4-e3f6f42f1ddf tempest-CreateVolumesFromSnapshotTest-389980398 None] Lock "cinder-8eca8bd5-c14a-46bd-8629-0b649acd773f-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:07 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e926d73d-279a-43dc-94dc-65641cc3a6ed tempest-CreateVolumesFromSourceVolumeTest-273309328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-32404c33-06c9-4362-b3ce-402d145627a1 1073741824" returned: 0 in 0.514s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:07 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e926d73d-279a-43dc-94dc-65641cc3a6ed tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-32404c33-06c9-4362-b3ce-402d145627a1 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:08 devstack sudo[90284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-32404c33-06c9-4362-b3ce-402d145627a1
Apr 02 10:35:08 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:08 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e926d73d-279a-43dc-94dc-65641cc3a6ed tempest-CreateVolumesFromSourceVolumeTest-273309328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-32404c33-06c9-4362-b3ce-402d145627a1" returned: 0 in 0.417s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-e926d73d-279a-43dc-94dc-65641cc3a6ed tempest-CreateVolumesFromSourceVolumeTest-273309328 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:35:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-e926d73d-279a-43dc-94dc-65641cc3a6ed tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d59d383a-35ea-4202-b8c1-7ba4aad4004a tempest-VolumeDependencyTests-1466340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.685s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d59d383a-35ea-4202-b8c1-7ba4aad4004a tempest-VolumeDependencyTests-1466340 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-496380052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d07869-e4ba-47d2-acfb-8311a459f59e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e1353b5f6e343c0896535424f8300ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:35:04Z,use_quota=True,user_id='afea7cd197ef4f3c9f4a091988c19f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:35:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-d59d383a-35ea-4202-b8c1-7ba4aad4004a tempest-VolumeDependencyTests-1466340 None] Creating volume 33d07869-e4ba-47d2-acfb-8311a459f59e {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:35:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d59d383a-35ea-4202-b8c1-7ba4aad4004a tempest-VolumeDependencyTests-1466340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d59d383a-35ea-4202-b8c1-7ba4aad4004a tempest-VolumeDependencyTests-1466340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d59d383a-35ea-4202-b8c1-7ba4aad4004a tempest-VolumeDependencyTests-1466340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:35:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d59d383a-35ea-4202-b8c1-7ba4aad4004a tempest-VolumeDependencyTests-1466340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:35:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d59d383a-35ea-4202-b8c1-7ba4aad4004a tempest-VolumeDependencyTests-1466340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d59d383a-35ea-4202-b8c1-7ba4aad4004a tempest-VolumeDependencyTests-1466340 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:35:08 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-d59d383a-35ea-4202-b8c1-7ba4aad4004a tempest-VolumeDependencyTests-1466340 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:35:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d59d383a-35ea-4202-b8c1-7ba4aad4004a tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e926d73d-279a-43dc-94dc-65641cc3a6ed tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d34bd12e-03a9-4e49-b7d2-fe243ff48647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32404c33-06c9-4362-b3ce-402d145627a1', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e926d73d-279a-43dc-94dc-65641cc3a6ed tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc4abf6-d70b-4bdf-8803-e22b1ffda365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:08 devstack sudo[90287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e 1073741824
Apr 02 10:35:08 devstack sudo[90287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:08 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-e926d73d-279a-43dc-94dc-65641cc3a6ed tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Volume volume-32404c33-06c9-4362-b3ce-402d145627a1 (32404c33-06c9-4362-b3ce-402d145627a1): created successfully
Apr 02 10:35:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e926d73d-279a-43dc-94dc-65641cc3a6ed tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc4abf6-d70b-4bdf-8803-e22b1ffda365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:08 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-e926d73d-279a-43dc-94dc-65641cc3a6ed tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Flow 'volume_create_manager' (fa683c27-4db0-4493-87e1-14c0cd81c06c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:35:08 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-e926d73d-279a-43dc-94dc-65641cc3a6ed tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Created volume successfully.
Apr 02 10:35:08 devstack cinder-volume[82102]: DEBUG oslo_service.periodic_task [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 02 10:35:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:35:08 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:35:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:08 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:08 devstack sudo[90289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:35:08 devstack sudo[90289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:09 devstack sudo[90287]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d59d383a-35ea-4202-b8c1-7ba4aad4004a tempest-VolumeDependencyTests-1466340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e 1073741824" returned: 0 in 0.595s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d59d383a-35ea-4202-b8c1-7ba4aad4004a tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:09 devstack sudo[90294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e
Apr 02 10:35:09 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:09 devstack sudo[90289]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.551s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-d4f13e3e-2ff2-4b80-be8f-bfca7d254351 None None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2c4f1142-7471-44a0-9ef9-76b825d1dc08 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Acquiring lock "cinder-32404c33-06c9-4362-b3ce-402d145627a1-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2c4f1142-7471-44a0-9ef9-76b825d1dc08 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "cinder-32404c33-06c9-4362-b3ce-402d145627a1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2c4f1142-7471-44a0-9ef9-76b825d1dc08 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Acquiring lock "cinder-quobyte-32404c33-06c9-4362-b3ce-402d145627a1" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2c4f1142-7471-44a0-9ef9-76b825d1dc08 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "cinder-quobyte-32404c33-06c9-4362-b3ce-402d145627a1" acquired by "delete_volume" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bca24a5-a40b-4ee3-b6c3-b3767a3bea87]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2c4f1142-7471-44a0-9ef9-76b825d1dc08 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-32404c33-06c9-4362-b3ce-402d145627a1 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:09 devstack sudo[90297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-32404c33-06c9-4362-b3ce-402d145627a1
Apr 02 10:35:09 devstack sudo[90297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:09 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-d59d383a-35ea-4202-b8c1-7ba4aad4004a tempest-VolumeDependencyTests-1466340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e" returned: 0 in 0.464s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-d59d383a-35ea-4202-b8c1-7ba4aad4004a tempest-VolumeDependencyTests-1466340 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-d59d383a-35ea-4202-b8c1-7ba4aad4004a tempest-VolumeDependencyTests-1466340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.638s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Acquiring lock "cinder-quobyte-8b3640d3-cd51-48f2-9d70-db5eaeff9a44-d3bfe145-1ec3-49ac-9195-6f28a813c770" by "_create_volume_from_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d59d383a-35ea-4202-b8c1-7ba4aad4004a tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3958a8b7-51e8-465a-8351-02268a43418a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33d07869-e4ba-47d2-acfb-8311a459f59e', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d59d383a-35ea-4202-b8c1-7ba4aad4004a tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f34a1d3-c51c-4ab0-88c0-7dcc35c97bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:09 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-d59d383a-35ea-4202-b8c1-7ba4aad4004a tempest-VolumeDependencyTests-1466340 None] Volume volume-33d07869-e4ba-47d2-acfb-8311a459f59e (33d07869-e4ba-47d2-acfb-8311a459f59e): created successfully
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d59d383a-35ea-4202-b8c1-7ba4aad4004a tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f34a1d3-c51c-4ab0-88c0-7dcc35c97bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-d59d383a-35ea-4202-b8c1-7ba4aad4004a tempest-VolumeDependencyTests-1466340 None] Flow 'volume_create_manager' (21b98de2-861d-4cc3-9f92-eec12c99cd94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Lock "cinder-quobyte-8b3640d3-cd51-48f2-9d70-db5eaeff9a44-d3bfe145-1ec3-49ac-9195-6f28a813c770" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Creating volume d3bfe145-1ec3-49ac-9195-6f28a813c770 from snapshot 8b3640d3-cd51-48f2-9d70-db5eaeff9a44 {{(pid=82102) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Acquiring lock "cinder-quobyte-d3bfe145-1ec3-49ac-9195-6f28a813c770" by "_copy_volume_from_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:09 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-d59d383a-35ea-4202-b8c1-7ba4aad4004a tempest-VolumeDependencyTests-1466340 None] Created volume successfully.
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Lock "cinder-quobyte-d3bfe145-1ec3-49ac-9195-6f28a813c770" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] snapshot: 8b3640d3-cd51-48f2-9d70-db5eaeff9a44, volume: d3bfe145-1ec3-49ac-9195-6f28a813c770,  {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae10d22-3fd3-4083-9c41-d59b2f18f681]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808.8b3640d3-cd51-48f2-9d70-db5eaeff9a44 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:09 devstack sudo[90300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808.8b3640d3-cd51-48f2-9d70-db5eaeff9a44
Apr 02 10:35:09 devstack sudo[90300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:09 devstack sudo[90297]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2c4f1142-7471-44a0-9ef9-76b825d1dc08 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-32404c33-06c9-4362-b3ce-402d145627a1" returned: 0 in 0.512s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:09 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2c4f1142-7471-44a0-9ef9-76b825d1dc08 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-32404c33-06c9-4362-b3ce-402d145627a1 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:09 devstack sudo[90305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-32404c33-06c9-4362-b3ce-402d145627a1
Apr 02 10:35:09 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Flow 'volume_create_manager' (268c50c0-abad-48b0-91f7-2b1fab103dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35f6e2b0-9714-439a-8b78-c307115af983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35f6e2b0-9714-439a-8b78-c307115af983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-209879828',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f770b3a9-1e94-44a9-a7a9-50c455eb41b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e1353b5f6e343c0896535424f8300ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=33d07869-e4ba-47d2-acfb-8311a459f59e,status='creating',terminated_at=None,updated_at=2026-04-02T08:35:10Z,use_quota=True,user_id='afea7cd197ef4f3c9f4a091988c19f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d0e97f-ea5e-4e60-983f-69232abb1232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d0e97f-ea5e-4e60-983f-69232abb1232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae43082d-077c-4077-8d08-0e3a55e15945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:10 devstack sudo[90300]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae43082d-077c-4077-8d08-0e3a55e15945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f770b3a9-1e94-44a9-a7a9-50c455eb41b7', 'volume_name': 'volume-f770b3a9-1e94-44a9-a7a9-50c455eb41b7', 'volume_size': 1, 'source_volid': '33d07869-e4ba-47d2-acfb-8311a459f59e', 'source_volstatus': 'available'}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d668a929-cc81-4d25-957d-8c4f42d7899b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d668a929-cc81-4d25-957d-8c4f42d7899b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6601815c-fd81-4918-b0a5-9f6961a804aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:10 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Volume f770b3a9-1e94-44a9-a7a9-50c455eb41b7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f770b3a9-1e94-44a9-a7a9-50c455eb41b7', 'volume_size': 1, 'source_volid': '33d07869-e4ba-47d2-acfb-8311a459f59e', 'source_volstatus': 'available'}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808.8b3640d3-cd51-48f2-9d70-db5eaeff9a44" returned: 0 in 0.706s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3219e7c-4a2a-4201-b860-13d416841808(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808 {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Creating direct copy from snapshot {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:10 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[92760338-ba51-4584-b3d2-80e3765be758]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2c4f1142-7471-44a0-9ef9-76b825d1dc08 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-32404c33-06c9-4362-b3ce-402d145627a1" returned: 0 in 0.540s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2c4f1142-7471-44a0-9ef9-76b825d1dc08 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "cinder-quobyte-32404c33-06c9-4362-b3ce-402d145627a1" released by "delete_volume" :: held 1.079s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-2c4f1142-7471-44a0-9ef9-76b825d1dc08 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Created reservations ['38e0308e-f6d6-4261-9238-befd4c065c3d', '363905ae-d042-45ab-9091-1b47f631e35f', 'c5fdc785-60b3-445a-aab3-26fabf0dba4f', 'ed2458ba-78cf-49ab-b168-96ac394352b5'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:35:10 devstack sudo[90311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808
Apr 02 10:35:10 devstack sudo[90311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-580e755b-eb3a-4f26-8a1a-7bf1c794769f tempest-CinderUnicodeTest-1795447600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-580e755b-eb3a-4f26-8a1a-7bf1c794769f tempest-CinderUnicodeTest-1795447600 None] Flow 'volume_create_manager' (05401cfd-90ed-4778-9c20-7f62cdb01452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-580e755b-eb3a-4f26-8a1a-7bf1c794769f tempest-CinderUnicodeTest-1795447600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ee486be-4246-4bce-be4f-05cefb47a5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-2c4f1142-7471-44a0-9ef9-76b825d1dc08 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-2c4f1142-7471-44a0-9ef9-76b825d1dc08 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-2c4f1142-7471-44a0-9ef9-76b825d1dc08 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-2c4f1142-7471-44a0-9ef9-76b825d1dc08 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-2c4f1142-7471-44a0-9ef9-76b825d1dc08 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2c4f1142-7471-44a0-9ef9-76b825d1dc08 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:10 devstack sudo[90313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:35:10 devstack sudo[90313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-580e755b-eb3a-4f26-8a1a-7bf1c794769f tempest-CinderUnicodeTest-1795447600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ee486be-4246-4bce-be4f-05cefb47a5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6864e833-edfc-491d-82c2-eccb9822b6fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f3134c0d5243fca5b02363f0a9498a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:35:10Z,use_quota=True,user_id='e4349c2503614ad9a7cb9d49edfa6633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-580e755b-eb3a-4f26-8a1a-7bf1c794769f tempest-CinderUnicodeTest-1795447600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (654936be-fb22-4698-ba97-51dbec114b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-580e755b-eb3a-4f26-8a1a-7bf1c794769f tempest-CinderUnicodeTest-1795447600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (654936be-fb22-4698-ba97-51dbec114b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-580e755b-eb3a-4f26-8a1a-7bf1c794769f tempest-CinderUnicodeTest-1795447600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bff7fc8-7f74-400f-8e6e-caf3ac69995a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-580e755b-eb3a-4f26-8a1a-7bf1c794769f tempest-CinderUnicodeTest-1795447600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bff7fc8-7f74-400f-8e6e-caf3ac69995a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6864e833-edfc-491d-82c2-eccb9822b6fb', 'volume_name': 'volume-6864e833-edfc-491d-82c2-eccb9822b6fb', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-580e755b-eb3a-4f26-8a1a-7bf1c794769f tempest-CinderUnicodeTest-1795447600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (335d828a-131d-4b95-80f5-652d5a8b771b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-580e755b-eb3a-4f26-8a1a-7bf1c794769f tempest-CinderUnicodeTest-1795447600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (335d828a-131d-4b95-80f5-652d5a8b771b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-580e755b-eb3a-4f26-8a1a-7bf1c794769f tempest-CinderUnicodeTest-1795447600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18bf0c90-639f-452c-ba7a-3bc85a3be7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:10 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-580e755b-eb3a-4f26-8a1a-7bf1c794769f tempest-CinderUnicodeTest-1795447600 None] Volume 6864e833-edfc-491d-82c2-eccb9822b6fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6864e833-edfc-491d-82c2-eccb9822b6fb', 'volume_size': 1}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-580e755b-eb3a-4f26-8a1a-7bf1c794769f tempest-CinderUnicodeTest-1795447600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:10 devstack sudo[90311]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808" returned: 0 in 0.483s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG cinder.utils [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Path /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d3bfe145-1ec3-49ac-9195-6f28a813c770 not found in is_blk_device check {{(pid=82102) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d3bfe145-1ec3-49ac-9195-6f28a813c770 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:10 devstack sudo[90319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d3bfe145-1ec3-49ac-9195-6f28a813c770
Apr 02 10:35:10 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:10 devstack sudo[90313]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-2c4f1142-7471-44a0-9ef9-76b825d1dc08 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.411s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-2c4f1142-7471-44a0-9ef9-76b825d1dc08 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:35:10 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-2c4f1142-7471-44a0-9ef9-76b825d1dc08 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Deleted volume successfully.
Apr 02 10:35:10 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-2c4f1142-7471-44a0-9ef9-76b825d1dc08 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "cinder-32404c33-06c9-4362-b3ce-402d145627a1-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:11 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9f44d292-a965-41b0-92e7-ec315f9ef3d8 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Acquiring lock "cinder-36ee8c1a-4900-434b-be0d-83e9eb870164-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:11 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9f44d292-a965-41b0-92e7-ec315f9ef3d8 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "cinder-36ee8c1a-4900-434b-be0d-83e9eb870164-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:11 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9f44d292-a965-41b0-92e7-ec315f9ef3d8 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Acquiring lock "cinder-quobyte-36ee8c1a-4900-434b-be0d-83e9eb870164" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:11 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9f44d292-a965-41b0-92e7-ec315f9ef3d8 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "cinder-quobyte-36ee8c1a-4900-434b-be0d-83e9eb870164" acquired by "delete_volume" :: waited 0.024s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:11 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f04042-38f9-4617-88e2-337e13f4fa4d]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:35:11 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9f44d292-a965-41b0-92e7-ec315f9ef3d8 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-36ee8c1a-4900-434b-be0d-83e9eb870164 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:11 devstack sudo[90332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-36ee8c1a-4900-434b-be0d-83e9eb870164
Apr 02 10:35:11 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:12 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9f44d292-a965-41b0-92e7-ec315f9ef3d8 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-36ee8c1a-4900-434b-be0d-83e9eb870164" returned: 0 in 0.857s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9f44d292-a965-41b0-92e7-ec315f9ef3d8 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-36ee8c1a-4900-434b-be0d-83e9eb870164 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:12 devstack sudo[90337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-36ee8c1a-4900-434b-be0d-83e9eb870164
Apr 02 10:35:12 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:12 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d3bfe145-1ec3-49ac-9195-6f28a813c770" returned: 0 in 2.023s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:12 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0fc370-8b99-48a3-ac93-f66412f30ed2]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:35:12 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:12 devstack sudo[90339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808
Apr 02 10:35:12 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:13 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9f44d292-a965-41b0-92e7-ec315f9ef3d8 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-36ee8c1a-4900-434b-be0d-83e9eb870164" returned: 0 in 0.557s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:13 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9f44d292-a965-41b0-92e7-ec315f9ef3d8 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "cinder-quobyte-36ee8c1a-4900-434b-be0d-83e9eb870164" released by "delete_volume" :: held 1.451s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:13 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-9f44d292-a965-41b0-92e7-ec315f9ef3d8 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Created reservations ['805d9809-d980-4c3b-8dc9-33107a4268fd', '42c941e2-9abf-4991-be5a-f23ad1b43847', '323bbc18-b7d0-4a3c-8c62-c1f426780136', '38793fe9-506a-48b0-94a4-6bbe9e3eefa2'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:35:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-9f44d292-a965-41b0-92e7-ec315f9ef3d8 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-9f44d292-a965-41b0-92e7-ec315f9ef3d8 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:13 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-9f44d292-a965-41b0-92e7-ec315f9ef3d8 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:35:13 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-9f44d292-a965-41b0-92e7-ec315f9ef3d8 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:35:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-9f44d292-a965-41b0-92e7-ec315f9ef3d8 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9f44d292-a965-41b0-92e7-ec315f9ef3d8 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:13 devstack sudo[90342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:35:13 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:13 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808" returned: 0 in 0.556s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:13 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Image conversion details: src /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808, size 1024.00 MB, duration 2.02 sec, destination /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d3bfe145-1ec3-49ac-9195-6f28a813c770 {{(pid=82102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 02 10:35:13 devstack cinder-volume[82102]: INFO cinder.image.image_utils [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Converted 1024.00 MB image at 505.87 MB/s
Apr 02 10:35:13 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d3bfe145-1ec3-49ac-9195-6f28a813c770 is being set with open permissions: ugo+rw
Apr 02 10:35:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d3bfe145-1ec3-49ac-9195-6f28a813c770 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:13 devstack sudo[90347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d3bfe145-1ec3-49ac-9195-6f28a813c770
Apr 02 10:35:13 devstack sudo[90347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:13 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-9f44d292-a965-41b0-92e7-ec315f9ef3d8 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.388s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:13 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-9f44d292-a965-41b0-92e7-ec315f9ef3d8 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:35:13 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-9f44d292-a965-41b0-92e7-ec315f9ef3d8 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Deleted volume successfully.
Apr 02 10:35:13 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-9f44d292-a965-41b0-92e7-ec315f9ef3d8 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "cinder-36ee8c1a-4900-434b-be0d-83e9eb870164-delete_volume" released by "delete_volume" :: held 2.046s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:13 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-20421019-eedc-42f1-a85d-137c709b1b04 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Acquiring lock "cinder-ee3e6d57-b40f-4aa2-a974-37c7d0b7ee00-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:13 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-20421019-eedc-42f1-a85d-137c709b1b04 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "cinder-ee3e6d57-b40f-4aa2-a974-37c7d0b7ee00-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:13 devstack sudo[90347]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d3bfe145-1ec3-49ac-9195-6f28a813c770" returned: 0 in 0.421s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:13 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Lock "cinder-quobyte-d3bfe145-1ec3-49ac-9195-6f28a813c770" released by "_copy_volume_from_snapshot" :: held 4.270s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:13 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Lock "cinder-quobyte-8b3640d3-cd51-48f2-9d70-db5eaeff9a44-d3bfe145-1ec3-49ac-9195-6f28a813c770" released by "_create_volume_from_snapshot" :: held 4.306s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.347s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.544s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:13 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Cloning volume 33d07869-e4ba-47d2-acfb-8311a459f59e to volume f770b3a9-1e94-44a9-a7a9-50c455eb41b7
Apr 02 10:35:13 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-20421019-eedc-42f1-a85d-137c709b1b04 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Acquiring lock "cinder-quobyte-ee3e6d57-b40f-4aa2-a974-37c7d0b7ee00" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:13 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-20421019-eedc-42f1-a85d-137c709b1b04 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "cinder-quobyte-ee3e6d57-b40f-4aa2-a974-37c7d0b7ee00" acquired by "delete_volume" :: waited 0.021s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:13 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b69ef36-8f85-4257-85d4-1a7d3f74bc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3bfe145-1ec3-49ac-9195-6f28a813c770', 'volume_size': 1, 'snapshot_id': '8b3640d3-cd51-48f2-9d70-db5eaeff9a44'}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:13 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cf5d661-038f-4acc-9d92-f9faeadacc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:13 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dba63c4-c4a9-4df7-a528-e78f6bca4c83]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:35:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-20421019-eedc-42f1-a85d-137c709b1b04 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-ee3e6d57-b40f-4aa2-a974-37c7d0b7ee00 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:13 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Creating offline snapshot 2395ada7-2c31-44dd-9e83-c3a68f7466fd of volume 33d07869-e4ba-47d2-acfb-8311a459f59e {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:35:13 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Volume volume-d3bfe145-1ec3-49ac-9195-6f28a813c770 (d3bfe145-1ec3-49ac-9195-6f28a813c770): created successfully
Apr 02 10:35:13 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cf5d661-038f-4acc-9d92-f9faeadacc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:13 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Flow 'volume_create_manager' (55d594f7-5f14-4a43-870b-d5872af4aad9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:35:13 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4400d378-21a1-4edf-b2e1-dce4663f1f8a]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:35:13 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:13 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-69d84c8f-783c-48d1-8a9a-b83084751d2f tempest-SnapshotDependencyTests-1378294697 None] Created volume successfully.
Apr 02 10:35:14 devstack sudo[90351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-ee3e6d57-b40f-4aa2-a974-37c7d0b7ee00
Apr 02 10:35:14 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:14 devstack sudo[90352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e
Apr 02 10:35:14 devstack sudo[90352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:14 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a22816db-5d65-47f8-a69e-5ee33f304590 tempest-SnapshotDependencyTests-1378294697 None] Acquiring lock "cinder-8b3640d3-cd51-48f2-9d70-db5eaeff9a44-delete_snapshot" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:14 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a22816db-5d65-47f8-a69e-5ee33f304590 tempest-SnapshotDependencyTests-1378294697 None] Lock "cinder-8b3640d3-cd51-48f2-9d70-db5eaeff9a44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:14 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a22816db-5d65-47f8-a69e-5ee33f304590 tempest-SnapshotDependencyTests-1378294697 None] Acquiring lock "cinder-quobyte-e3219e7c-4a2a-4201-b860-13d416841808" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:14 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a22816db-5d65-47f8-a69e-5ee33f304590 tempest-SnapshotDependencyTests-1378294697 None] Lock "cinder-quobyte-e3219e7c-4a2a-4201-b860-13d416841808" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:14 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a22816db-5d65-47f8-a69e-5ee33f304590 tempest-SnapshotDependencyTests-1378294697 None] Acquiring lock "cinder-quobyte-8b3640d3-cd51-48f2-9d70-db5eaeff9a44" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:14 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a22816db-5d65-47f8-a69e-5ee33f304590 tempest-SnapshotDependencyTests-1378294697 None] Lock "cinder-quobyte-8b3640d3-cd51-48f2-9d70-db5eaeff9a44" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:14 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-a22816db-5d65-47f8-a69e-5ee33f304590 tempest-SnapshotDependencyTests-1378294697 None] Deleting offline snapshot 8b3640d3-cd51-48f2-9d70-db5eaeff9a44 of volume e3219e7c-4a2a-4201-b860-13d416841808 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:35:14 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-a22816db-5d65-47f8-a69e-5ee33f304590 tempest-SnapshotDependencyTests-1378294697 None] snapshot_file for this snap is: volume-e3219e7c-4a2a-4201-b860-13d416841808.8b3640d3-cd51-48f2-9d70-db5eaeff9a44 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:35:14 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8f05a8-e7c8-4875-a2db-bf52fbec3308]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:35:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a22816db-5d65-47f8-a69e-5ee33f304590 tempest-SnapshotDependencyTests-1378294697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808.8b3640d3-cd51-48f2-9d70-db5eaeff9a44 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:14 devstack sudo[90352]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e" returned: 0 in 0.495s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e.2395ada7-2c31-44dd-9e83-c3a68f7466fd 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:14 devstack sudo[90363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e.2395ada7-2c31-44dd-9e83-c3a68f7466fd 1G
Apr 02 10:35:14 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:14 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:14 devstack sudo[90362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808.8b3640d3-cd51-48f2-9d70-db5eaeff9a44
Apr 02 10:35:14 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-20421019-eedc-42f1-a85d-137c709b1b04 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-ee3e6d57-b40f-4aa2-a974-37c7d0b7ee00" returned: 0 in 0.565s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-20421019-eedc-42f1-a85d-137c709b1b04 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-ee3e6d57-b40f-4aa2-a974-37c7d0b7ee00 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:14 devstack sudo[90366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-ee3e6d57-b40f-4aa2-a974-37c7d0b7ee00
Apr 02 10:35:14 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:14 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a22816db-5d65-47f8-a69e-5ee33f304590 tempest-SnapshotDependencyTests-1378294697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808.8b3640d3-cd51-48f2-9d70-db5eaeff9a44" returned: 0 in 0.493s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:14 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-a22816db-5d65-47f8-a69e-5ee33f304590 tempest-SnapshotDependencyTests-1378294697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3219e7c-4a2a-4201-b860-13d416841808(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:35:14 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[677157d9-abed-493b-93c7-16f65c4754dc]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:35:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a22816db-5d65-47f8-a69e-5ee33f304590 tempest-SnapshotDependencyTests-1378294697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:14 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-20421019-eedc-42f1-a85d-137c709b1b04 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-ee3e6d57-b40f-4aa2-a974-37c7d0b7ee00" returned: 0 in 0.432s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:14 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-20421019-eedc-42f1-a85d-137c709b1b04 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "cinder-quobyte-ee3e6d57-b40f-4aa2-a974-37c7d0b7ee00" released by "delete_volume" :: held 1.031s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:14 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e.2395ada7-2c31-44dd-9e83-c3a68f7466fd 1G" returned: 0 in 0.494s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:14 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33d07869-e4ba-47d2-acfb-8311a459f59e -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e.2395ada7-2c31-44dd-9e83-c3a68f7466fd {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:14 devstack sudo[90376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33d07869-e4ba-47d2-acfb-8311a459f59e -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e.2395ada7-2c31-44dd-9e83-c3a68f7466fd
Apr 02 10:35:14 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:14 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-20421019-eedc-42f1-a85d-137c709b1b04 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Created reservations ['ba492613-f1a4-4ecf-9457-fdb74f512531', 'e876f58b-e269-4777-9a42-b6c05207091b', '57d65252-74ec-435c-b478-1669ca3bff23', '3bf85495-bc5b-4d04-86b5-8d2590867303'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:35:15 devstack sudo[90375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808
Apr 02 10:35:15 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-20421019-eedc-42f1-a85d-137c709b1b04 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-20421019-eedc-42f1-a85d-137c709b1b04 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-20421019-eedc-42f1-a85d-137c709b1b04 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:35:15 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-20421019-eedc-42f1-a85d-137c709b1b04 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:35:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-20421019-eedc-42f1-a85d-137c709b1b04 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-20421019-eedc-42f1-a85d-137c709b1b04 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:15 devstack sudo[90379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:35:15 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:15 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33d07869-e4ba-47d2-acfb-8311a459f59e -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e.2395ada7-2c31-44dd-9e83-c3a68f7466fd" returned: 0 in 0.419s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:15 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e.2395ada7-2c31-44dd-9e83-c3a68f7466fd is being set with open permissions: ugo+rw
Apr 02 10:35:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e.2395ada7-2c31-44dd-9e83-c3a68f7466fd {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:15 devstack sudo[90388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e.2395ada7-2c31-44dd-9e83-c3a68f7466fd
Apr 02 10:35:15 devstack sudo[90388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:15 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a22816db-5d65-47f8-a69e-5ee33f304590 tempest-SnapshotDependencyTests-1378294697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808" returned: 0 in 0.505s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a22816db-5d65-47f8-a69e-5ee33f304590 tempest-SnapshotDependencyTests-1378294697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808.8b3640d3-cd51-48f2-9d70-db5eaeff9a44 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:15 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-20421019-eedc-42f1-a85d-137c709b1b04 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.420s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:15 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-20421019-eedc-42f1-a85d-137c709b1b04 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:35:15 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-20421019-eedc-42f1-a85d-137c709b1b04 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Deleted volume successfully.
Apr 02 10:35:15 devstack sudo[90390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808.8b3640d3-cd51-48f2-9d70-db5eaeff9a44
Apr 02 10:35:15 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:15 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-20421019-eedc-42f1-a85d-137c709b1b04 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "cinder-ee3e6d57-b40f-4aa2-a974-37c7d0b7ee00-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:15 devstack sudo[90388]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e.2395ada7-2c31-44dd-9e83-c3a68f7466fd" returned: 0 in 0.429s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:15 devstack sudo[90396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e.info
Apr 02 10:35:15 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:15 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a22816db-5d65-47f8-a69e-5ee33f304590 tempest-SnapshotDependencyTests-1378294697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808.8b3640d3-cd51-48f2-9d70-db5eaeff9a44" returned: 0 in 0.469s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:15 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a22816db-5d65-47f8-a69e-5ee33f304590 tempest-SnapshotDependencyTests-1378294697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808.8b3640d3-cd51-48f2-9d70-db5eaeff9a44 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:15 devstack sudo[90398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808.8b3640d3-cd51-48f2-9d70-db5eaeff9a44
Apr 02 10:35:15 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:15 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-64d30add-c615-4810-adb1-05b968c2197f tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Acquiring lock "cinder-816eea4d-0717-47d5-bee7-6794d3de2fe8-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:16 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-64d30add-c615-4810-adb1-05b968c2197f tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "cinder-816eea4d-0717-47d5-bee7-6794d3de2fe8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:16 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-64d30add-c615-4810-adb1-05b968c2197f tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Acquiring lock "cinder-quobyte-816eea4d-0717-47d5-bee7-6794d3de2fe8" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:16 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-64d30add-c615-4810-adb1-05b968c2197f tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "cinder-quobyte-816eea4d-0717-47d5-bee7-6794d3de2fe8" acquired by "delete_volume" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:16 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb2cb73-b01e-44c1-b010-c1117b2419cd]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:35:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-64d30add-c615-4810-adb1-05b968c2197f tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-816eea4d-0717-47d5-bee7-6794d3de2fe8 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:16 devstack sudo[90400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-816eea4d-0717-47d5-bee7-6794d3de2fe8
Apr 02 10:35:16 devstack sudo[90400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:16 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e.info" returned: 0 in 0.441s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:16 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e.info is being set with open permissions: ugo+rw
Apr 02 10:35:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:16 devstack sudo[90404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e.info
Apr 02 10:35:16 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:16 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-a22816db-5d65-47f8-a69e-5ee33f304590 tempest-SnapshotDependencyTests-1378294697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808.8b3640d3-cd51-48f2-9d70-db5eaeff9a44" returned: 0 in 0.402s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:16 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a22816db-5d65-47f8-a69e-5ee33f304590 tempest-SnapshotDependencyTests-1378294697 None] Lock "cinder-quobyte-8b3640d3-cd51-48f2-9d70-db5eaeff9a44" released by "_delete_snapshot" :: held 1.933s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:16 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a22816db-5d65-47f8-a69e-5ee33f304590 tempest-SnapshotDependencyTests-1378294697 None] Lock "cinder-quobyte-e3219e7c-4a2a-4201-b860-13d416841808" released by "delete_snapshot" :: held 1.945s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:16 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-a22816db-5d65-47f8-a69e-5ee33f304590 tempest-SnapshotDependencyTests-1378294697 None] Created reservations ['d56547ba-c019-4d9e-b84a-429fba329dda', 'def5acd0-0992-4a3a-bb40-cfbcca903d6d', '882d3563-4e38-4f85-a2a7-51a41d0f8fb1', 'cad988f7-9687-42fe-affa-67a0424cedc7'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:35:16 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-a22816db-5d65-47f8-a69e-5ee33f304590 tempest-SnapshotDependencyTests-1378294697 None] Delete snapshot completed successfully.
Apr 02 10:35:16 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-a22816db-5d65-47f8-a69e-5ee33f304590 tempest-SnapshotDependencyTests-1378294697 None] Lock "cinder-8b3640d3-cd51-48f2-9d70-db5eaeff9a44-delete_snapshot" released by "delete_snapshot" :: held 2.031s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:16 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-ae369dce-f3f6-482a-9abd-18219d8dd0bf tempest-SnapshotDependencyTests-1378294697 None] Acquiring lock "cinder-e3219e7c-4a2a-4201-b860-13d416841808-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:16 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-ae369dce-f3f6-482a-9abd-18219d8dd0bf tempest-SnapshotDependencyTests-1378294697 None] Lock "cinder-e3219e7c-4a2a-4201-b860-13d416841808-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:16 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-ae369dce-f3f6-482a-9abd-18219d8dd0bf tempest-SnapshotDependencyTests-1378294697 None] Acquiring lock "cinder-quobyte-e3219e7c-4a2a-4201-b860-13d416841808" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:16 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-ae369dce-f3f6-482a-9abd-18219d8dd0bf tempest-SnapshotDependencyTests-1378294697 None] Lock "cinder-quobyte-e3219e7c-4a2a-4201-b860-13d416841808" acquired by "delete_volume" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:16 devstack sudo[90400]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-64d30add-c615-4810-adb1-05b968c2197f tempest-CreateVolumesFromSourceVolumeTest-273309328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-816eea4d-0717-47d5-bee7-6794d3de2fe8" returned: 0 in 0.519s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-64d30add-c615-4810-adb1-05b968c2197f tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-816eea4d-0717-47d5-bee7-6794d3de2fe8 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:16 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5445b39-32a8-4588-bb54-19fc3336d76c]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:35:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ae369dce-f3f6-482a-9abd-18219d8dd0bf tempest-SnapshotDependencyTests-1378294697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:16 devstack sudo[90409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-816eea4d-0717-47d5-bee7-6794d3de2fe8
Apr 02 10:35:16 devstack sudo[90409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:16 devstack sudo[90410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808
Apr 02 10:35:16 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:16 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e.info" returned: 0 in 0.443s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:16 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Acquiring lock "cinder-quobyte-f770b3a9-1e94-44a9-a7a9-50c455eb41b7" by "_copy_volume_from_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:16 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Lock "cinder-quobyte-f770b3a9-1e94-44a9-a7a9-50c455eb41b7" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:16 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] snapshot: 2395ada7-2c31-44dd-9e83-c3a68f7466fd, volume: f770b3a9-1e94-44a9-a7a9-50c455eb41b7,  {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 02 10:35:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:16 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:35:16 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:35:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:16 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd207a7-e2f7-4047-ac3a-67c1b5757e39]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:35:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e.2395ada7-2c31-44dd-9e83-c3a68f7466fd {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:16 devstack sudo[90414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e.2395ada7-2c31-44dd-9e83-c3a68f7466fd
Apr 02 10:35:16 devstack sudo[90414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:16 devstack sudo[90409]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:16 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-64d30add-c615-4810-adb1-05b968c2197f tempest-CreateVolumesFromSourceVolumeTest-273309328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-816eea4d-0717-47d5-bee7-6794d3de2fe8" returned: 0 in 0.394s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:16 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-64d30add-c615-4810-adb1-05b968c2197f tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "cinder-quobyte-816eea4d-0717-47d5-bee7-6794d3de2fe8" released by "delete_volume" :: held 0.938s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-64d30add-c615-4810-adb1-05b968c2197f tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Created reservations ['e9e2cbf9-82a1-4888-b1ae-d06a42e5dea8', '13ed634f-e0b8-4f77-b161-54813955cce3', 'dba52f7a-c102-4194-824c-0e84acd0dc81', '4480e9a4-d07a-4632-bf1c-687f4b5b2157'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-64d30add-c615-4810-adb1-05b968c2197f tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-64d30add-c615-4810-adb1-05b968c2197f tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-64d30add-c615-4810-adb1-05b968c2197f tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-64d30add-c615-4810-adb1-05b968c2197f tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-64d30add-c615-4810-adb1-05b968c2197f tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-64d30add-c615-4810-adb1-05b968c2197f tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:17 devstack sudo[90420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:35:17 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:17 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ae369dce-f3f6-482a-9abd-18219d8dd0bf tempest-SnapshotDependencyTests-1378294697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808" returned: 0 in 0.500s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ae369dce-f3f6-482a-9abd-18219d8dd0bf tempest-SnapshotDependencyTests-1378294697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:17 devstack sudo[90422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808
Apr 02 10:35:17 devstack sudo[90422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1bb36e39-7f63-4869-b784-e0b5531366f6 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Acquiring lock "cinder-4a1dadd0-5c92-4917-ae8f-15528be072f3-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1bb36e39-7f63-4869-b784-e0b5531366f6 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "cinder-4a1dadd0-5c92-4917-ae8f-15528be072f3-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1bb36e39-7f63-4869-b784-e0b5531366f6 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Acquiring lock "cinder-quobyte-4a1dadd0-5c92-4917-ae8f-15528be072f3" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1bb36e39-7f63-4869-b784-e0b5531366f6 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "cinder-quobyte-4a1dadd0-5c92-4917-ae8f-15528be072f3" acquired by "delete_volume" :: waited 0.007s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3171d977-205d-4540-b09f-1a33f36a2c02]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1bb36e39-7f63-4869-b784-e0b5531366f6 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4a1dadd0-5c92-4917-ae8f-15528be072f3 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:17 devstack sudo[90414]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e.2395ada7-2c31-44dd-9e83-c3a68f7466fd" returned: 0 in 0.526s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33d07869-e4ba-47d2-acfb-8311a459f59e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Creating direct copy from snapshot {{(pid=82102) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8637c88a-d398-4b26-9112-988c83e08c36]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:17 devstack sudo[90427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4a1dadd0-5c92-4917-ae8f-15528be072f3
Apr 02 10:35:17 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:17 devstack sudo[90428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e
Apr 02 10:35:17 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:17 devstack sudo[90422]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ae369dce-f3f6-482a-9abd-18219d8dd0bf tempest-SnapshotDependencyTests-1378294697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-e3219e7c-4a2a-4201-b860-13d416841808" returned: 0 in 0.417s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-ae369dce-f3f6-482a-9abd-18219d8dd0bf tempest-SnapshotDependencyTests-1378294697 None] Lock "cinder-quobyte-e3219e7c-4a2a-4201-b860-13d416841808" released by "delete_volume" :: held 0.965s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:17 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-64d30add-c615-4810-adb1-05b968c2197f tempest-CreateVolumesFromSourceVolumeTest-273309328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.514s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-64d30add-c615-4810-adb1-05b968c2197f tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:35:17 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-64d30add-c615-4810-adb1-05b968c2197f tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Deleted volume successfully.
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-ae369dce-f3f6-482a-9abd-18219d8dd0bf tempest-SnapshotDependencyTests-1378294697 None] Created reservations ['418ac08d-3b8f-4fa4-abcc-f60bf09150d1', '15fc9152-ee21-4218-a269-d1fdefc96679', '5650c63a-9e96-4f97-8797-8cc65e158a4c', 'f3cda114-84ff-4453-ac66-3f7903c71553'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-64d30add-c615-4810-adb1-05b968c2197f tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "cinder-816eea4d-0717-47d5-bee7-6794d3de2fe8-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ae369dce-f3f6-482a-9abd-18219d8dd0bf tempest-SnapshotDependencyTests-1378294697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ae369dce-f3f6-482a-9abd-18219d8dd0bf tempest-SnapshotDependencyTests-1378294697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-ae369dce-f3f6-482a-9abd-18219d8dd0bf tempest-SnapshotDependencyTests-1378294697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-ae369dce-f3f6-482a-9abd-18219d8dd0bf tempest-SnapshotDependencyTests-1378294697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-ae369dce-f3f6-482a-9abd-18219d8dd0bf tempest-SnapshotDependencyTests-1378294697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ae369dce-f3f6-482a-9abd-18219d8dd0bf tempest-SnapshotDependencyTests-1378294697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:17 devstack sudo[90436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:35:17 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:17 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1bb36e39-7f63-4869-b784-e0b5531366f6 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4a1dadd0-5c92-4917-ae8f-15528be072f3" returned: 0 in 0.493s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1bb36e39-7f63-4869-b784-e0b5531366f6 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4a1dadd0-5c92-4917-ae8f-15528be072f3 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:17 devstack sudo[90439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4a1dadd0-5c92-4917-ae8f-15528be072f3
Apr 02 10:35:17 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:17 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e" returned: 0 in 0.513s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG cinder.utils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Path /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f770b3a9-1e94-44a9-a7a9-50c455eb41b7 not found in is_blk_device check {{(pid=82102) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 02 10:35:17 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f770b3a9-1e94-44a9-a7a9-50c455eb41b7 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:17 devstack sudo[90443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f770b3a9-1e94-44a9-a7a9-50c455eb41b7
Apr 02 10:35:17 devstack sudo[90443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:18 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-ae369dce-f3f6-482a-9abd-18219d8dd0bf tempest-SnapshotDependencyTests-1378294697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.392s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:18 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-ae369dce-f3f6-482a-9abd-18219d8dd0bf tempest-SnapshotDependencyTests-1378294697 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:35:18 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-ae369dce-f3f6-482a-9abd-18219d8dd0bf tempest-SnapshotDependencyTests-1378294697 None] Deleted volume successfully.
Apr 02 10:35:18 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-ae369dce-f3f6-482a-9abd-18219d8dd0bf tempest-SnapshotDependencyTests-1378294697 None] Lock "cinder-e3219e7c-4a2a-4201-b860-13d416841808-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:18 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1bb36e39-7f63-4869-b784-e0b5531366f6 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-4a1dadd0-5c92-4917-ae8f-15528be072f3" returned: 0 in 0.396s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:18 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1bb36e39-7f63-4869-b784-e0b5531366f6 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "cinder-quobyte-4a1dadd0-5c92-4917-ae8f-15528be072f3" released by "delete_volume" :: held 0.913s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:18 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-1bb36e39-7f63-4869-b784-e0b5531366f6 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Created reservations ['8a75ed0e-e3a2-41ed-98f5-bbc6d5552c9f', '86b1c984-7b4c-4b52-a833-30826b43b425', '9894280b-9865-40c9-8089-0e8a29bf695c', '45cb8c40-9d5e-4e66-9a58-08ee95ec3fa3'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:35:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-1bb36e39-7f63-4869-b784-e0b5531366f6 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-1bb36e39-7f63-4869-b784-e0b5531366f6 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:18 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-1bb36e39-7f63-4869-b784-e0b5531366f6 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:35:18 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-1bb36e39-7f63-4869-b784-e0b5531366f6 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:35:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-1bb36e39-7f63-4869-b784-e0b5531366f6 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1bb36e39-7f63-4869-b784-e0b5531366f6 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:18 devstack sudo[90450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:35:18 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:18 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-91649e0e-bb57-4adc-9a5e-99ff54e59faa tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Acquiring lock "cinder-43ae7732-5953-4573-b187-7ebe32f85977-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:18 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-91649e0e-bb57-4adc-9a5e-99ff54e59faa tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "cinder-43ae7732-5953-4573-b187-7ebe32f85977-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:18 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-91649e0e-bb57-4adc-9a5e-99ff54e59faa tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Acquiring lock "cinder-quobyte-43ae7732-5953-4573-b187-7ebe32f85977" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:18 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-91649e0e-bb57-4adc-9a5e-99ff54e59faa tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "cinder-quobyte-43ae7732-5953-4573-b187-7ebe32f85977" acquired by "delete_volume" :: waited 0.021s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:18 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3322ea-fc78-4485-8290-235ee529c8b9]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:35:18 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-91649e0e-bb57-4adc-9a5e-99ff54e59faa tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-43ae7732-5953-4573-b187-7ebe32f85977 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:18 devstack sudo[90459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-43ae7732-5953-4573-b187-7ebe32f85977
Apr 02 10:35:18 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:19 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-38a4ad10-3cd8-442d-93a7-e1cae59efa5b tempest-SnapshotDependencyTests-1378294697 None] Acquiring lock "cinder-d3bfe145-1ec3-49ac-9195-6f28a813c770-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:19 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-38a4ad10-3cd8-442d-93a7-e1cae59efa5b tempest-SnapshotDependencyTests-1378294697 None] Lock "cinder-d3bfe145-1ec3-49ac-9195-6f28a813c770-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:19 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-38a4ad10-3cd8-442d-93a7-e1cae59efa5b tempest-SnapshotDependencyTests-1378294697 None] Acquiring lock "cinder-quobyte-d3bfe145-1ec3-49ac-9195-6f28a813c770" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:19 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-38a4ad10-3cd8-442d-93a7-e1cae59efa5b tempest-SnapshotDependencyTests-1378294697 None] Lock "cinder-quobyte-d3bfe145-1ec3-49ac-9195-6f28a813c770" acquired by "delete_volume" :: waited 0.028s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:19 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[438a826f-7d02-4082-ac1f-47843448ff06]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:35:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-38a4ad10-3cd8-442d-93a7-e1cae59efa5b tempest-SnapshotDependencyTests-1378294697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d3bfe145-1ec3-49ac-9195-6f28a813c770 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:19 devstack sudo[90461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d3bfe145-1ec3-49ac-9195-6f28a813c770
Apr 02 10:35:19 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:19 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-1bb36e39-7f63-4869-b784-e0b5531366f6 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 1.680s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:19 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-1bb36e39-7f63-4869-b784-e0b5531366f6 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:35:19 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-1bb36e39-7f63-4869-b784-e0b5531366f6 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Deleted volume successfully.
Apr 02 10:35:19 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-1bb36e39-7f63-4869-b784-e0b5531366f6 tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "cinder-4a1dadd0-5c92-4917-ae8f-15528be072f3-delete_volume" released by "delete_volume" :: held 2.762s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:19 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-91649e0e-bb57-4adc-9a5e-99ff54e59faa tempest-CreateVolumesFromSourceVolumeTest-273309328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-43ae7732-5953-4573-b187-7ebe32f85977" returned: 0 in 1.489s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-91649e0e-bb57-4adc-9a5e-99ff54e59faa tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-43ae7732-5953-4573-b187-7ebe32f85977 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:19 devstack sudo[90443]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f770b3a9-1e94-44a9-a7a9-50c455eb41b7" returned: 0 in 2.170s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:19 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[371552f9-7623-411e-8ed1-69a7df5a288a]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:35:19 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:19 devstack sudo[90467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-43ae7732-5953-4573-b187-7ebe32f85977
Apr 02 10:35:19 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:20 devstack sudo[90468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e
Apr 02 10:35:20 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:20 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-38a4ad10-3cd8-442d-93a7-e1cae59efa5b tempest-SnapshotDependencyTests-1378294697 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d3bfe145-1ec3-49ac-9195-6f28a813c770" returned: 0 in 0.970s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-38a4ad10-3cd8-442d-93a7-e1cae59efa5b tempest-SnapshotDependencyTests-1378294697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d3bfe145-1ec3-49ac-9195-6f28a813c770 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:20 devstack sudo[90474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d3bfe145-1ec3-49ac-9195-6f28a813c770
Apr 02 10:35:20 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:20 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-91649e0e-bb57-4adc-9a5e-99ff54e59faa tempest-CreateVolumesFromSourceVolumeTest-273309328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-43ae7732-5953-4573-b187-7ebe32f85977" returned: 0 in 0.409s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:20 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-91649e0e-bb57-4adc-9a5e-99ff54e59faa tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "cinder-quobyte-43ae7732-5953-4573-b187-7ebe32f85977" released by "delete_volume" :: held 1.933s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:20 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-91649e0e-bb57-4adc-9a5e-99ff54e59faa tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Created reservations ['19872496-8d39-4236-8612-b16c90cb0cd2', '94f80903-1966-4e95-abc3-e639043c5982', 'dc47eb1e-1874-4593-bb5f-b1c3e7847f68', '04e47b29-8a7f-4afc-96b2-77d19e01c97b'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:35:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-91649e0e-bb57-4adc-9a5e-99ff54e59faa tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-91649e0e-bb57-4adc-9a5e-99ff54e59faa tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:20 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-91649e0e-bb57-4adc-9a5e-99ff54e59faa tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:35:20 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-91649e0e-bb57-4adc-9a5e-99ff54e59faa tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:35:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-91649e0e-bb57-4adc-9a5e-99ff54e59faa tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-91649e0e-bb57-4adc-9a5e-99ff54e59faa tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:20 devstack sudo[90479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:35:20 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:20 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e" returned: 0 in 0.577s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:20 devstack cinder-volume[82102]: DEBUG cinder.image.image_utils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Image conversion details: src /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e, size 1024.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f770b3a9-1e94-44a9-a7a9-50c455eb41b7 {{(pid=82102) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 02 10:35:20 devstack cinder-volume[82102]: INFO cinder.image.image_utils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Converted 1024.00 MB image at 471.38 MB/s
Apr 02 10:35:20 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f770b3a9-1e94-44a9-a7a9-50c455eb41b7 is being set with open permissions: ugo+rw
Apr 02 10:35:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f770b3a9-1e94-44a9-a7a9-50c455eb41b7 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:20 devstack sudo[90483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f770b3a9-1e94-44a9-a7a9-50c455eb41b7
Apr 02 10:35:20 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:20 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-38a4ad10-3cd8-442d-93a7-e1cae59efa5b tempest-SnapshotDependencyTests-1378294697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-d3bfe145-1ec3-49ac-9195-6f28a813c770" returned: 0 in 0.434s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:20 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-38a4ad10-3cd8-442d-93a7-e1cae59efa5b tempest-SnapshotDependencyTests-1378294697 None] Lock "cinder-quobyte-d3bfe145-1ec3-49ac-9195-6f28a813c770" released by "delete_volume" :: held 1.438s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:20 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-38a4ad10-3cd8-442d-93a7-e1cae59efa5b tempest-SnapshotDependencyTests-1378294697 None] Created reservations ['77894f7b-354a-48f3-b65e-f95a9fd3f960', 'c08a37c3-c46e-4ec5-99dd-7d2ae97cdc64', '7f26dae3-dbcc-4c34-b474-ac5feee516e7', '77d7df66-a219-4d9e-9158-5ebf9421523c'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:35:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-38a4ad10-3cd8-442d-93a7-e1cae59efa5b tempest-SnapshotDependencyTests-1378294697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-38a4ad10-3cd8-442d-93a7-e1cae59efa5b tempest-SnapshotDependencyTests-1378294697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:20 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-38a4ad10-3cd8-442d-93a7-e1cae59efa5b tempest-SnapshotDependencyTests-1378294697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:35:20 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-38a4ad10-3cd8-442d-93a7-e1cae59efa5b tempest-SnapshotDependencyTests-1378294697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:35:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-38a4ad10-3cd8-442d-93a7-e1cae59efa5b tempest-SnapshotDependencyTests-1378294697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-38a4ad10-3cd8-442d-93a7-e1cae59efa5b tempest-SnapshotDependencyTests-1378294697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:20 devstack sudo[90485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:35:20 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:20 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:20 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-91649e0e-bb57-4adc-9a5e-99ff54e59faa tempest-CreateVolumesFromSourceVolumeTest-273309328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.463s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:20 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-91649e0e-bb57-4adc-9a5e-99ff54e59faa tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:35:20 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-91649e0e-bb57-4adc-9a5e-99ff54e59faa tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Deleted volume successfully.
Apr 02 10:35:20 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-91649e0e-bb57-4adc-9a5e-99ff54e59faa tempest-CreateVolumesFromSourceVolumeTest-273309328 None] Lock "cinder-43ae7732-5953-4573-b187-7ebe32f85977-delete_volume" released by "delete_volume" :: held 2.606s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:21 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f770b3a9-1e94-44a9-a7a9-50c455eb41b7" returned: 0 in 0.469s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:21 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Lock "cinder-quobyte-f770b3a9-1e94-44a9-a7a9-50c455eb41b7" released by "_copy_volume_from_snapshot" :: held 4.298s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:21 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Acquiring lock "cinder-quobyte-2395ada7-2c31-44dd-9e83-c3a68f7466fd" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:21 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Lock "cinder-quobyte-2395ada7-2c31-44dd-9e83-c3a68f7466fd" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:21 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Deleting offline snapshot 2395ada7-2c31-44dd-9e83-c3a68f7466fd of volume 33d07869-e4ba-47d2-acfb-8311a459f59e {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:35:21 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] snapshot_file for this snap is: volume-33d07869-e4ba-47d2-acfb-8311a459f59e.2395ada7-2c31-44dd-9e83-c3a68f7466fd {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:35:21 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2d43d5-8425-4a9f-9c53-a44b1295c684]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:35:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e.2395ada7-2c31-44dd-9e83-c3a68f7466fd {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:21 devstack sudo[90491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e.2395ada7-2c31-44dd-9e83-c3a68f7466fd
Apr 02 10:35:21 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:21 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-38a4ad10-3cd8-442d-93a7-e1cae59efa5b tempest-SnapshotDependencyTests-1378294697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.466s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:21 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-38a4ad10-3cd8-442d-93a7-e1cae59efa5b tempest-SnapshotDependencyTests-1378294697 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:35:21 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-38a4ad10-3cd8-442d-93a7-e1cae59efa5b tempest-SnapshotDependencyTests-1378294697 None] Deleted volume successfully.
Apr 02 10:35:21 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-38a4ad10-3cd8-442d-93a7-e1cae59efa5b tempest-SnapshotDependencyTests-1378294697 None] Lock "cinder-d3bfe145-1ec3-49ac-9195-6f28a813c770-delete_volume" released by "delete_volume" :: held 2.128s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:21 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e.2395ada7-2c31-44dd-9e83-c3a68f7466fd" returned: 0 in 0.508s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:21 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33d07869-e4ba-47d2-acfb-8311a459f59e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:35:21 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[29eaa981-0ee2-4eed-b74b-f56a7364c4f0]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:35:21 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:21 devstack sudo[90496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e
Apr 02 10:35:21 devstack sudo[90496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:22 devstack sudo[90496]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e" returned: 0 in 0.490s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e.2395ada7-2c31-44dd-9e83-c3a68f7466fd {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:22 devstack sudo[90501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e.2395ada7-2c31-44dd-9e83-c3a68f7466fd
Apr 02 10:35:22 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:22 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e.2395ada7-2c31-44dd-9e83-c3a68f7466fd" returned: 0 in 0.461s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e.2395ada7-2c31-44dd-9e83-c3a68f7466fd {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:22 devstack sudo[90507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e.2395ada7-2c31-44dd-9e83-c3a68f7466fd
Apr 02 10:35:22 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:22 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:22 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e.2395ada7-2c31-44dd-9e83-c3a68f7466fd" returned: 0 in 0.410s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:22 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Lock "cinder-quobyte-2395ada7-2c31-44dd-9e83-c3a68f7466fd" released by "_delete_snapshot" :: held 1.920s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.119s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-580e755b-eb3a-4f26-8a1a-7bf1c794769f tempest-CinderUnicodeTest-1795447600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.454s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:23 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-580e755b-eb3a-4f26-8a1a-7bf1c794769f tempest-CinderUnicodeTest-1795447600 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6864e833-edfc-491d-82c2-eccb9822b6fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f3134c0d5243fca5b02363f0a9498a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:35:10Z,use_quota=True,user_id='e4349c2503614ad9a7cb9d49edfa6633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:35:23 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-580e755b-eb3a-4f26-8a1a-7bf1c794769f tempest-CinderUnicodeTest-1795447600 None] Creating volume 6864e833-edfc-491d-82c2-eccb9822b6fb {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:35:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-580e755b-eb3a-4f26-8a1a-7bf1c794769f tempest-CinderUnicodeTest-1795447600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-580e755b-eb3a-4f26-8a1a-7bf1c794769f tempest-CinderUnicodeTest-1795447600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:23 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-580e755b-eb3a-4f26-8a1a-7bf1c794769f tempest-CinderUnicodeTest-1795447600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:35:23 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-580e755b-eb3a-4f26-8a1a-7bf1c794769f tempest-CinderUnicodeTest-1795447600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:35:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-580e755b-eb3a-4f26-8a1a-7bf1c794769f tempest-CinderUnicodeTest-1795447600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:23 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-580e755b-eb3a-4f26-8a1a-7bf1c794769f tempest-CinderUnicodeTest-1795447600 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:35:23 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-580e755b-eb3a-4f26-8a1a-7bf1c794769f tempest-CinderUnicodeTest-1795447600 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:35:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-580e755b-eb3a-4f26-8a1a-7bf1c794769f tempest-CinderUnicodeTest-1795447600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6864e833-edfc-491d-82c2-eccb9822b6fb 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6601815c-fd81-4918-b0a5-9f6961a804aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f770b3a9-1e94-44a9-a7a9-50c455eb41b7', 'volume_size': 1, 'source_volid': '33d07869-e4ba-47d2-acfb-8311a459f59e', 'source_volstatus': 'available'}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6c0e46-616a-4892-b9c2-1ed17a243b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:23 devstack sudo[90510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6864e833-edfc-491d-82c2-eccb9822b6fb 1073741824
Apr 02 10:35:23 devstack sudo[90510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:23 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Volume volume-f770b3a9-1e94-44a9-a7a9-50c455eb41b7 (f770b3a9-1e94-44a9-a7a9-50c455eb41b7): created successfully
Apr 02 10:35:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6c0e46-616a-4892-b9c2-1ed17a243b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Flow 'volume_create_manager' (268c50c0-abad-48b0-91f7-2b1fab103dd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:35:23 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-22ecf9a4-ae68-4029-99ca-b0cf6a5b0e9d tempest-VolumeDependencyTests-1466340 None] Created volume successfully.
Apr 02 10:35:23 devstack sudo[90510]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-580e755b-eb3a-4f26-8a1a-7bf1c794769f tempest-CinderUnicodeTest-1795447600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6864e833-edfc-491d-82c2-eccb9822b6fb 1073741824" returned: 0 in 0.483s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-580e755b-eb3a-4f26-8a1a-7bf1c794769f tempest-CinderUnicodeTest-1795447600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6864e833-edfc-491d-82c2-eccb9822b6fb {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:23 devstack sudo[90516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6864e833-edfc-491d-82c2-eccb9822b6fb
Apr 02 10:35:23 devstack sudo[90516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:23 devstack sudo[90516]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-580e755b-eb3a-4f26-8a1a-7bf1c794769f tempest-CinderUnicodeTest-1795447600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6864e833-edfc-491d-82c2-eccb9822b6fb" returned: 0 in 0.416s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:23 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-580e755b-eb3a-4f26-8a1a-7bf1c794769f tempest-CinderUnicodeTest-1795447600 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:35:23 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-580e755b-eb3a-4f26-8a1a-7bf1c794769f tempest-CinderUnicodeTest-1795447600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-580e755b-eb3a-4f26-8a1a-7bf1c794769f tempest-CinderUnicodeTest-1795447600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18bf0c90-639f-452c-ba7a-3bc85a3be7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6864e833-edfc-491d-82c2-eccb9822b6fb', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-580e755b-eb3a-4f26-8a1a-7bf1c794769f tempest-CinderUnicodeTest-1795447600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5d9aff2-3991-4802-a19a-b9162e182acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:23 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-580e755b-eb3a-4f26-8a1a-7bf1c794769f tempest-CinderUnicodeTest-1795447600 None] Volume volume-6864e833-edfc-491d-82c2-eccb9822b6fb (6864e833-edfc-491d-82c2-eccb9822b6fb): created successfully
Apr 02 10:35:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-580e755b-eb3a-4f26-8a1a-7bf1c794769f tempest-CinderUnicodeTest-1795447600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5d9aff2-3991-4802-a19a-b9162e182acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:23 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-580e755b-eb3a-4f26-8a1a-7bf1c794769f tempest-CinderUnicodeTest-1795447600 None] Flow 'volume_create_manager' (05401cfd-90ed-4778-9c20-7f62cdb01452) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:35:23 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-580e755b-eb3a-4f26-8a1a-7bf1c794769f tempest-CinderUnicodeTest-1795447600 None] Created volume successfully.
Apr 02 10:35:24 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c470c374-59a0-4bef-a611-b10981c2671f tempest-VolumeDependencyTests-1466340 None] Acquiring lock "cinder-33d07869-e4ba-47d2-acfb-8311a459f59e-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:24 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c470c374-59a0-4bef-a611-b10981c2671f tempest-VolumeDependencyTests-1466340 None] Lock "cinder-33d07869-e4ba-47d2-acfb-8311a459f59e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:24 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c470c374-59a0-4bef-a611-b10981c2671f tempest-VolumeDependencyTests-1466340 None] Acquiring lock "cinder-quobyte-33d07869-e4ba-47d2-acfb-8311a459f59e" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:24 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c470c374-59a0-4bef-a611-b10981c2671f tempest-VolumeDependencyTests-1466340 None] Lock "cinder-quobyte-33d07869-e4ba-47d2-acfb-8311a459f59e" acquired by "delete_volume" :: waited 0.007s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:24 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc19dfc-e19e-4375-9f1a-cf957b49f9a6]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:35:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c470c374-59a0-4bef-a611-b10981c2671f tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:24 devstack sudo[90520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e
Apr 02 10:35:24 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:24 devstack cinder-volume[82102]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb8ba129-d2bb-46e6-b3e0-f4d6d4a28359 tempest-CinderUnicodeTest-1795447600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82102) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 02 10:35:24 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-fb8ba129-d2bb-46e6-b3e0-f4d6d4a28359 tempest-CinderUnicodeTest-1795447600 None] Flow 'volume_create_manager' (ebc2d5a5-059a-491d-b5a4-ee027846bd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:35:24 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-fb8ba129-d2bb-46e6-b3e0-f4d6d4a28359 tempest-CinderUnicodeTest-1795447600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e78da387-8cfb-40cc-a3ee-61852f5fc333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:24 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-fb8ba129-d2bb-46e6-b3e0-f4d6d4a28359 tempest-CinderUnicodeTest-1795447600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e78da387-8cfb-40cc-a3ee-61852f5fc333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:35:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1363924507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3155a40-abaf-4ad7-a95b-ab36715a7d8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f3134c0d5243fca5b02363f0a9498a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:35:25Z,use_quota=True,user_id='e4349c2503614ad9a7cb9d49edfa6633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:24 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-fb8ba129-d2bb-46e6-b3e0-f4d6d4a28359 tempest-CinderUnicodeTest-1795447600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3ec956d-207c-4e0e-b238-2cb9598d7972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:24 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-fb8ba129-d2bb-46e6-b3e0-f4d6d4a28359 tempest-CinderUnicodeTest-1795447600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3ec956d-207c-4e0e-b238-2cb9598d7972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:24 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-fb8ba129-d2bb-46e6-b3e0-f4d6d4a28359 tempest-CinderUnicodeTest-1795447600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2524f763-6ca2-4955-b7bb-8d1c5b9892cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:24 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-fb8ba129-d2bb-46e6-b3e0-f4d6d4a28359 tempest-CinderUnicodeTest-1795447600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2524f763-6ca2-4955-b7bb-8d1c5b9892cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3155a40-abaf-4ad7-a95b-ab36715a7d8d', 'volume_name': 'volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:24 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-fb8ba129-d2bb-46e6-b3e0-f4d6d4a28359 tempest-CinderUnicodeTest-1795447600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3694a98f-3adb-48bd-a997-b015de642c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:24 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-fb8ba129-d2bb-46e6-b3e0-f4d6d4a28359 tempest-CinderUnicodeTest-1795447600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3694a98f-3adb-48bd-a997-b015de642c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:24 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-fb8ba129-d2bb-46e6-b3e0-f4d6d4a28359 tempest-CinderUnicodeTest-1795447600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d77d3ed-cfd8-4cb4-a129-713ba235a6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:24 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-fb8ba129-d2bb-46e6-b3e0-f4d6d4a28359 tempest-CinderUnicodeTest-1795447600 None] Volume f3155a40-abaf-4ad7-a95b-ab36715a7d8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d', 'volume_size': 1}
Apr 02 10:35:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-fb8ba129-d2bb-46e6-b3e0-f4d6d4a28359 tempest-CinderUnicodeTest-1795447600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-fb8ba129-d2bb-46e6-b3e0-f4d6d4a28359 tempest-CinderUnicodeTest-1795447600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:24 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-fb8ba129-d2bb-46e6-b3e0-f4d6d4a28359 tempest-CinderUnicodeTest-1795447600 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f636e3832b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-02T08:35:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1363924507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3155a40-abaf-4ad7-a95b-ab36715a7d8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f3134c0d5243fca5b02363f0a9498a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-02T08:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-02T08:35:25Z,use_quota=True,user_id='e4349c2503614ad9a7cb9d49edfa6633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e9b0759-a1b4-403e-bedb-6dae91ea9bd5),volume_type_id=8e9b0759-a1b4-403e-bedb-6dae91ea9bd5)}" {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 02 10:35:24 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-fb8ba129-d2bb-46e6-b3e0-f4d6d4a28359 tempest-CinderUnicodeTest-1795447600 None] Creating volume f3155a40-abaf-4ad7-a95b-ab36715a7d8d {{(pid=82102) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 02 10:35:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-fb8ba129-d2bb-46e6-b3e0-f4d6d4a28359 tempest-CinderUnicodeTest-1795447600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-fb8ba129-d2bb-46e6-b3e0-f4d6d4a28359 tempest-CinderUnicodeTest-1795447600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:24 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-fb8ba129-d2bb-46e6-b3e0-f4d6d4a28359 tempest-CinderUnicodeTest-1795447600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:35:24 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-fb8ba129-d2bb-46e6-b3e0-f4d6d4a28359 tempest-CinderUnicodeTest-1795447600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:35:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-fb8ba129-d2bb-46e6-b3e0-f4d6d4a28359 tempest-CinderUnicodeTest-1795447600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:24 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-fb8ba129-d2bb-46e6-b3e0-f4d6d4a28359 tempest-CinderUnicodeTest-1795447600 None] Selected osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091 as target Quobyte volume. {{(pid=82102) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 02 10:35:24 devstack cinder-volume[82102]: INFO cinder.volume.drivers.remotefs [None req-fb8ba129-d2bb-46e6-b3e0-f4d6d4a28359 tempest-CinderUnicodeTest-1795447600 None] casted to osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091
Apr 02 10:35:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-fb8ba129-d2bb-46e6-b3e0-f4d6d4a28359 tempest-CinderUnicodeTest-1795447600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d 1073741824 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:24 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c470c374-59a0-4bef-a611-b10981c2671f tempest-VolumeDependencyTests-1466340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e" returned: 0 in 0.571s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:24 devstack sudo[90525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d 1073741824
Apr 02 10:35:24 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c470c374-59a0-4bef-a611-b10981c2671f tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:24 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:24 devstack sudo[90527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e
Apr 02 10:35:24 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:25 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c470c374-59a0-4bef-a611-b10981c2671f tempest-VolumeDependencyTests-1466340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-33d07869-e4ba-47d2-acfb-8311a459f59e" returned: 0 in 0.420s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:25 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c470c374-59a0-4bef-a611-b10981c2671f tempest-VolumeDependencyTests-1466340 None] Lock "cinder-quobyte-33d07869-e4ba-47d2-acfb-8311a459f59e" released by "delete_volume" :: held 1.030s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:25 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-fb8ba129-d2bb-46e6-b3e0-f4d6d4a28359 tempest-CinderUnicodeTest-1795447600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d 1073741824" returned: 0 in 0.495s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:25 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-c470c374-59a0-4bef-a611-b10981c2671f tempest-VolumeDependencyTests-1466340 None] Created reservations ['e47344bb-3ac0-4b0c-b322-c63be122ad3d', '242a8599-b63e-4472-972a-072d685e74a4', 'efbabbe4-bfd8-473c-a35b-d913938e770c', '9789471e-360e-465e-86bb-ca096001d182'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:35:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-fb8ba129-d2bb-46e6-b3e0-f4d6d4a28359 tempest-CinderUnicodeTest-1795447600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:25 devstack sudo[90534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d
Apr 02 10:35:25 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-c470c374-59a0-4bef-a611-b10981c2671f tempest-VolumeDependencyTests-1466340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-c470c374-59a0-4bef-a611-b10981c2671f tempest-VolumeDependencyTests-1466340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:25 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-c470c374-59a0-4bef-a611-b10981c2671f tempest-VolumeDependencyTests-1466340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:35:25 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-c470c374-59a0-4bef-a611-b10981c2671f tempest-VolumeDependencyTests-1466340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:35:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-c470c374-59a0-4bef-a611-b10981c2671f tempest-VolumeDependencyTests-1466340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c470c374-59a0-4bef-a611-b10981c2671f tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:25 devstack sudo[90536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:35:25 devstack sudo[90536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:25 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-fb8ba129-d2bb-46e6-b3e0-f4d6d4a28359 tempest-CinderUnicodeTest-1795447600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d" returned: 0 in 0.402s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:25 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-fb8ba129-d2bb-46e6-b3e0-f4d6d4a28359 tempest-CinderUnicodeTest-1795447600 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'} {{(pid=82102) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 02 10:35:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-fb8ba129-d2bb-46e6-b3e0-f4d6d4a28359 tempest-CinderUnicodeTest-1795447600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-fb8ba129-d2bb-46e6-b3e0-f4d6d4a28359 tempest-CinderUnicodeTest-1795447600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d77d3ed-cfd8-4cb4-a129-713ba235a6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d', 'volume_size': 1}' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-fb8ba129-d2bb-46e6-b3e0-f4d6d4a28359 tempest-CinderUnicodeTest-1795447600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3e12ac8-7c9d-4b74-9acd-97fea8f1cf82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 02 10:35:25 devstack cinder-volume[82102]: INFO cinder.volume.flows.manager.create_volume [None req-fb8ba129-d2bb-46e6-b3e0-f4d6d4a28359 tempest-CinderUnicodeTest-1795447600 None] Volume volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d (f3155a40-abaf-4ad7-a95b-ab36715a7d8d): created successfully
Apr 02 10:35:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-fb8ba129-d2bb-46e6-b3e0-f4d6d4a28359 tempest-CinderUnicodeTest-1795447600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3e12ac8-7c9d-4b74-9acd-97fea8f1cf82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82102) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 02 10:35:25 devstack cinder-volume[82102]: DEBUG cinder.volume.manager [None req-fb8ba129-d2bb-46e6-b3e0-f4d6d4a28359 tempest-CinderUnicodeTest-1795447600 None] Flow 'volume_create_manager' (ebc2d5a5-059a-491d-b5a4-ee027846bd9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82102) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 02 10:35:25 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-fb8ba129-d2bb-46e6-b3e0-f4d6d4a28359 tempest-CinderUnicodeTest-1795447600 None] Created volume successfully.
Apr 02 10:35:25 devstack sudo[90536]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:25 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-c470c374-59a0-4bef-a611-b10981c2671f tempest-VolumeDependencyTests-1466340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.440s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:25 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-c470c374-59a0-4bef-a611-b10981c2671f tempest-VolumeDependencyTests-1466340 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:35:25 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-c470c374-59a0-4bef-a611-b10981c2671f tempest-VolumeDependencyTests-1466340 None] Deleted volume successfully.
Apr 02 10:35:25 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-c470c374-59a0-4bef-a611-b10981c2671f tempest-VolumeDependencyTests-1466340 None] Lock "cinder-33d07869-e4ba-47d2-acfb-8311a459f59e-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:26 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-57b92f25-12c4-4e72-ac77-80ab81c4a69d tempest-VolumeDependencyTests-1466340 None] Acquiring lock "cinder-f770b3a9-1e94-44a9-a7a9-50c455eb41b7-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:26 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-57b92f25-12c4-4e72-ac77-80ab81c4a69d tempest-VolumeDependencyTests-1466340 None] Lock "cinder-f770b3a9-1e94-44a9-a7a9-50c455eb41b7-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:26 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-57b92f25-12c4-4e72-ac77-80ab81c4a69d tempest-VolumeDependencyTests-1466340 None] Acquiring lock "cinder-quobyte-f770b3a9-1e94-44a9-a7a9-50c455eb41b7" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:26 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-57b92f25-12c4-4e72-ac77-80ab81c4a69d tempest-VolumeDependencyTests-1466340 None] Lock "cinder-quobyte-f770b3a9-1e94-44a9-a7a9-50c455eb41b7" acquired by "delete_volume" :: waited 0.022s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:26 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2ec2b2-1d09-48b6-8924-2ce93ce86aea]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:35:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-57b92f25-12c4-4e72-ac77-80ab81c4a69d tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f770b3a9-1e94-44a9-a7a9-50c455eb41b7 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:26 devstack sudo[90540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f770b3a9-1e94-44a9-a7a9-50c455eb41b7
Apr 02 10:35:26 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:26 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-57b92f25-12c4-4e72-ac77-80ab81c4a69d tempest-VolumeDependencyTests-1466340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f770b3a9-1e94-44a9-a7a9-50c455eb41b7" returned: 0 in 0.509s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-57b92f25-12c4-4e72-ac77-80ab81c4a69d tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f770b3a9-1e94-44a9-a7a9-50c455eb41b7 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:26 devstack sudo[90546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f770b3a9-1e94-44a9-a7a9-50c455eb41b7
Apr 02 10:35:26 devstack sudo[90546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3460d094-8729-43f0-9eba-32addac02682 tempest-CinderUnicodeTest-1795447600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3460d094-8729-43f0-9eba-32addac02682 tempest-CinderUnicodeTest-1795447600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:26 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-3460d094-8729-43f0-9eba-32addac02682 tempest-CinderUnicodeTest-1795447600 None] Creating offline snapshot 54221ca4-d214-4e26-97dd-062565eb53f1 of volume f3155a40-abaf-4ad7-a95b-ab36715a7d8d {{(pid=82102) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 02 10:35:26 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d825f1-194e-40cc-81fd-2f48c5bc9390]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:35:26 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3460d094-8729-43f0-9eba-32addac02682 tempest-CinderUnicodeTest-1795447600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:27 devstack sudo[90548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d
Apr 02 10:35:27 devstack sudo[90548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:27 devstack sudo[90546]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-57b92f25-12c4-4e72-ac77-80ab81c4a69d tempest-VolumeDependencyTests-1466340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f770b3a9-1e94-44a9-a7a9-50c455eb41b7" returned: 0 in 0.440s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:27 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-57b92f25-12c4-4e72-ac77-80ab81c4a69d tempest-VolumeDependencyTests-1466340 None] Lock "cinder-quobyte-f770b3a9-1e94-44a9-a7a9-50c455eb41b7" released by "delete_volume" :: held 0.976s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:27 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-57b92f25-12c4-4e72-ac77-80ab81c4a69d tempest-VolumeDependencyTests-1466340 None] Created reservations ['f9db6cd0-2244-49e1-a942-3ed25dd8aae1', '7c44abfc-95c3-4477-bf41-8eac8df1173e', 'a4842738-e0f9-48de-b4f8-77af6d8b2fce', 'bcfa7e28-ec86-4ff7-a5da-abdfae0f9278'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:35:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-57b92f25-12c4-4e72-ac77-80ab81c4a69d tempest-VolumeDependencyTests-1466340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-57b92f25-12c4-4e72-ac77-80ab81c4a69d tempest-VolumeDependencyTests-1466340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:27 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-57b92f25-12c4-4e72-ac77-80ab81c4a69d tempest-VolumeDependencyTests-1466340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:35:27 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-57b92f25-12c4-4e72-ac77-80ab81c4a69d tempest-VolumeDependencyTests-1466340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:35:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-57b92f25-12c4-4e72-ac77-80ab81c4a69d tempest-VolumeDependencyTests-1466340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-57b92f25-12c4-4e72-ac77-80ab81c4a69d tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:27 devstack sudo[90551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:35:27 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:27 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-626b5146-1eb4-438c-a7f8-a0ac37fd7e33 tempest-VolumeDependencyTests-1466340 None] Acquiring lock "cinder-8367d611-3cbd-49eb-82b4-b95dfd2607f3-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:27 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-626b5146-1eb4-438c-a7f8-a0ac37fd7e33 tempest-VolumeDependencyTests-1466340 None] Lock "cinder-8367d611-3cbd-49eb-82b4-b95dfd2607f3-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:27 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-626b5146-1eb4-438c-a7f8-a0ac37fd7e33 tempest-VolumeDependencyTests-1466340 None] Acquiring lock "cinder-quobyte-8367d611-3cbd-49eb-82b4-b95dfd2607f3" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:27 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-626b5146-1eb4-438c-a7f8-a0ac37fd7e33 tempest-VolumeDependencyTests-1466340 None] Lock "cinder-quobyte-8367d611-3cbd-49eb-82b4-b95dfd2607f3" acquired by "delete_volume" :: waited 0.009s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:27 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c070a8-3b45-4a1d-b2d5-7e5a24a7410f]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:35:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-626b5146-1eb4-438c-a7f8-a0ac37fd7e33 tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8367d611-3cbd-49eb-82b4-b95dfd2607f3 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:27 devstack sudo[90548]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3460d094-8729-43f0-9eba-32addac02682 tempest-CinderUnicodeTest-1795447600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d" returned: 0 in 0.651s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3460d094-8729-43f0-9eba-32addac02682 tempest-CinderUnicodeTest-1795447600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d.54221ca4-d214-4e26-97dd-062565eb53f1 1G {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:27 devstack sudo[90557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d.54221ca4-d214-4e26-97dd-062565eb53f1 1G
Apr 02 10:35:27 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:27 devstack sudo[90556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8367d611-3cbd-49eb-82b4-b95dfd2607f3
Apr 02 10:35:27 devstack sudo[90556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:27 devstack sudo[90551]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:27 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-57b92f25-12c4-4e72-ac77-80ab81c4a69d tempest-VolumeDependencyTests-1466340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.460s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:27 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-57b92f25-12c4-4e72-ac77-80ab81c4a69d tempest-VolumeDependencyTests-1466340 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:35:27 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-57b92f25-12c4-4e72-ac77-80ab81c4a69d tempest-VolumeDependencyTests-1466340 None] Deleted volume successfully.
Apr 02 10:35:27 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-57b92f25-12c4-4e72-ac77-80ab81c4a69d tempest-VolumeDependencyTests-1466340 None] Lock "cinder-f770b3a9-1e94-44a9-a7a9-50c455eb41b7-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:28 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3460d094-8729-43f0-9eba-32addac02682 tempest-CinderUnicodeTest-1795447600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d.54221ca4-d214-4e26-97dd-062565eb53f1 1G" returned: 0 in 0.474s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3460d094-8729-43f0-9eba-32addac02682 tempest-CinderUnicodeTest-1795447600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d.54221ca4-d214-4e26-97dd-062565eb53f1 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:28 devstack sudo[90556]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-626b5146-1eb4-438c-a7f8-a0ac37fd7e33 tempest-VolumeDependencyTests-1466340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8367d611-3cbd-49eb-82b4-b95dfd2607f3" returned: 0 in 0.506s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-626b5146-1eb4-438c-a7f8-a0ac37fd7e33 tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8367d611-3cbd-49eb-82b4-b95dfd2607f3 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:28 devstack sudo[90567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d.54221ca4-d214-4e26-97dd-062565eb53f1
Apr 02 10:35:28 devstack sudo[90567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:28 devstack sudo[90568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8367d611-3cbd-49eb-82b4-b95dfd2607f3
Apr 02 10:35:28 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:28 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-626b5146-1eb4-438c-a7f8-a0ac37fd7e33 tempest-VolumeDependencyTests-1466340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-8367d611-3cbd-49eb-82b4-b95dfd2607f3" returned: 0 in 0.384s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:28 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-626b5146-1eb4-438c-a7f8-a0ac37fd7e33 tempest-VolumeDependencyTests-1466340 None] Lock "cinder-quobyte-8367d611-3cbd-49eb-82b4-b95dfd2607f3" released by "delete_volume" :: held 0.914s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:28 devstack sudo[90567]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3460d094-8729-43f0-9eba-32addac02682 tempest-CinderUnicodeTest-1795447600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d -F qcow2 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d.54221ca4-d214-4e26-97dd-062565eb53f1" returned: 0 in 0.429s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:28 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-3460d094-8729-43f0-9eba-32addac02682 tempest-CinderUnicodeTest-1795447600 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d.54221ca4-d214-4e26-97dd-062565eb53f1 is being set with open permissions: ugo+rw
Apr 02 10:35:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3460d094-8729-43f0-9eba-32addac02682 tempest-CinderUnicodeTest-1795447600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d.54221ca4-d214-4e26-97dd-062565eb53f1 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:28 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-626b5146-1eb4-438c-a7f8-a0ac37fd7e33 tempest-VolumeDependencyTests-1466340 None] Created reservations ['d465b869-134e-43ae-8964-9f230cb772d2', '7cac4be9-5e13-4b63-8c6f-850284fc353f', '57ab02a2-c3e1-4b85-8f2e-d7376fcd1b2a', 'faddf1dc-c640-4991-bc35-095f69a2fb58'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:35:28 devstack sudo[90575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d.54221ca4-d214-4e26-97dd-062565eb53f1
Apr 02 10:35:28 devstack sudo[90575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-626b5146-1eb4-438c-a7f8-a0ac37fd7e33 tempest-VolumeDependencyTests-1466340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-626b5146-1eb4-438c-a7f8-a0ac37fd7e33 tempest-VolumeDependencyTests-1466340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:28 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-626b5146-1eb4-438c-a7f8-a0ac37fd7e33 tempest-VolumeDependencyTests-1466340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:35:28 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-626b5146-1eb4-438c-a7f8-a0ac37fd7e33 tempest-VolumeDependencyTests-1466340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:35:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-626b5146-1eb4-438c-a7f8-a0ac37fd7e33 tempest-VolumeDependencyTests-1466340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-626b5146-1eb4-438c-a7f8-a0ac37fd7e33 tempest-VolumeDependencyTests-1466340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:28 devstack sudo[90577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:35:28 devstack sudo[90577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:28 devstack sudo[90575]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3460d094-8729-43f0-9eba-32addac02682 tempest-CinderUnicodeTest-1795447600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d.54221ca4-d214-4e26-97dd-062565eb53f1" returned: 0 in 0.417s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:28 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3460d094-8729-43f0-9eba-32addac02682 tempest-CinderUnicodeTest-1795447600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:28 devstack sudo[90580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d.info
Apr 02 10:35:28 devstack sudo[90580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:29 devstack sudo[90577]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-626b5146-1eb4-438c-a7f8-a0ac37fd7e33 tempest-VolumeDependencyTests-1466340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.491s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:29 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-626b5146-1eb4-438c-a7f8-a0ac37fd7e33 tempest-VolumeDependencyTests-1466340 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:35:29 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-626b5146-1eb4-438c-a7f8-a0ac37fd7e33 tempest-VolumeDependencyTests-1466340 None] Deleted volume successfully.
Apr 02 10:35:29 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-626b5146-1eb4-438c-a7f8-a0ac37fd7e33 tempest-VolumeDependencyTests-1466340 None] Lock "cinder-8367d611-3cbd-49eb-82b4-b95dfd2607f3-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:29 devstack sudo[90580]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3460d094-8729-43f0-9eba-32addac02682 tempest-CinderUnicodeTest-1795447600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d.info" returned: 0 in 0.453s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:29 devstack cinder-volume[82102]: WARNING cinder.volume.drivers.remotefs [None req-3460d094-8729-43f0-9eba-32addac02682 tempest-CinderUnicodeTest-1795447600 None] /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d.info is being set with open permissions: ugo+rw
Apr 02 10:35:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3460d094-8729-43f0-9eba-32addac02682 tempest-CinderUnicodeTest-1795447600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d.info {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:29 devstack sudo[90586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d.info
Apr 02 10:35:29 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:29 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-3460d094-8729-43f0-9eba-32addac02682 tempest-CinderUnicodeTest-1795447600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d.info" returned: 0 in 0.428s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:29 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-3460d094-8729-43f0-9eba-32addac02682 tempest-CinderUnicodeTest-1795447600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.930s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:29 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-3460d094-8729-43f0-9eba-32addac02682 tempest-CinderUnicodeTest-1795447600 None] Create snapshot completed successfully
Apr 02 10:35:30 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-e2d42d67-5f66-46e4-9d45-816fe550ca5c tempest-CinderUnicodeTest-1795447600 None] Acquiring lock "cinder-54221ca4-d214-4e26-97dd-062565eb53f1-delete_snapshot" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:30 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-e2d42d67-5f66-46e4-9d45-816fe550ca5c tempest-CinderUnicodeTest-1795447600 None] Lock "cinder-54221ca4-d214-4e26-97dd-062565eb53f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:30 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-e2d42d67-5f66-46e4-9d45-816fe550ca5c tempest-CinderUnicodeTest-1795447600 None] Acquiring lock "cinder-quobyte-f3155a40-abaf-4ad7-a95b-ab36715a7d8d" by "delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:30 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-e2d42d67-5f66-46e4-9d45-816fe550ca5c tempest-CinderUnicodeTest-1795447600 None] Lock "cinder-quobyte-f3155a40-abaf-4ad7-a95b-ab36715a7d8d" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:30 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-e2d42d67-5f66-46e4-9d45-816fe550ca5c tempest-CinderUnicodeTest-1795447600 None] Acquiring lock "cinder-quobyte-54221ca4-d214-4e26-97dd-062565eb53f1" by "_delete_snapshot" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:30 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-e2d42d67-5f66-46e4-9d45-816fe550ca5c tempest-CinderUnicodeTest-1795447600 None] Lock "cinder-quobyte-54221ca4-d214-4e26-97dd-062565eb53f1" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:30 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-e2d42d67-5f66-46e4-9d45-816fe550ca5c tempest-CinderUnicodeTest-1795447600 None] Deleting offline snapshot 54221ca4-d214-4e26-97dd-062565eb53f1 of volume f3155a40-abaf-4ad7-a95b-ab36715a7d8d {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 02 10:35:30 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-e2d42d67-5f66-46e4-9d45-816fe550ca5c tempest-CinderUnicodeTest-1795447600 None] snapshot_file for this snap is: volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d.54221ca4-d214-4e26-97dd-062565eb53f1 {{(pid=82102) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 02 10:35:30 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[89746c9f-3820-4350-8085-3f9ce69532ef]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:35:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e2d42d67-5f66-46e4-9d45-816fe550ca5c tempest-CinderUnicodeTest-1795447600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d.54221ca4-d214-4e26-97dd-062565eb53f1 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:30 devstack sudo[90589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d.54221ca4-d214-4e26-97dd-062565eb53f1
Apr 02 10:35:30 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:30 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e2d42d67-5f66-46e4-9d45-816fe550ca5c tempest-CinderUnicodeTest-1795447600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d.54221ca4-d214-4e26-97dd-062565eb53f1" returned: 0 in 0.441s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:30 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.remotefs [None req-e2d42d67-5f66-46e4-9d45-816fe550ca5c tempest-CinderUnicodeTest-1795447600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82102) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 02 10:35:30 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad5172f-9741-43ac-8c69-b102ce4f5fb1]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:35:30 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e2d42d67-5f66-46e4-9d45-816fe550ca5c tempest-CinderUnicodeTest-1795447600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:30 devstack sudo[90594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d
Apr 02 10:35:30 devstack sudo[90594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:31 devstack sudo[90594]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e2d42d67-5f66-46e4-9d45-816fe550ca5c tempest-CinderUnicodeTest-1795447600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d" returned: 0 in 0.443s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e2d42d67-5f66-46e4-9d45-816fe550ca5c tempest-CinderUnicodeTest-1795447600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d.54221ca4-d214-4e26-97dd-062565eb53f1 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:31 devstack sudo[90600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d.54221ca4-d214-4e26-97dd-062565eb53f1
Apr 02 10:35:31 devstack sudo[90600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:31 devstack sudo[90600]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e2d42d67-5f66-46e4-9d45-816fe550ca5c tempest-CinderUnicodeTest-1795447600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d.54221ca4-d214-4e26-97dd-062565eb53f1" returned: 0 in 0.410s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e2d42d67-5f66-46e4-9d45-816fe550ca5c tempest-CinderUnicodeTest-1795447600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d.54221ca4-d214-4e26-97dd-062565eb53f1 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:31 devstack sudo[90605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d.54221ca4-d214-4e26-97dd-062565eb53f1
Apr 02 10:35:31 devstack sudo[90605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:31 devstack sudo[90605]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:31 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-e2d42d67-5f66-46e4-9d45-816fe550ca5c tempest-CinderUnicodeTest-1795447600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d.54221ca4-d214-4e26-97dd-062565eb53f1" returned: 0 in 0.381s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:31 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-e2d42d67-5f66-46e4-9d45-816fe550ca5c tempest-CinderUnicodeTest-1795447600 None] Lock "cinder-quobyte-54221ca4-d214-4e26-97dd-062565eb53f1" released by "_delete_snapshot" :: held 1.733s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:31 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-e2d42d67-5f66-46e4-9d45-816fe550ca5c tempest-CinderUnicodeTest-1795447600 None] Lock "cinder-quobyte-f3155a40-abaf-4ad7-a95b-ab36715a7d8d" released by "delete_snapshot" :: held 1.744s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:31 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-e2d42d67-5f66-46e4-9d45-816fe550ca5c tempest-CinderUnicodeTest-1795447600 None] Created reservations ['b7114a95-1b6d-4c29-b78b-26ee7712e729', '570055a4-dda3-438d-b268-e1f9aad6a3e6', 'b6357127-20d5-4f25-a4b4-f2e9d138d38b', '26f02dbc-c507-4ebb-9c51-29f6637dac0e'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:35:31 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-e2d42d67-5f66-46e4-9d45-816fe550ca5c tempest-CinderUnicodeTest-1795447600 None] Delete snapshot completed successfully.
Apr 02 10:35:31 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-e2d42d67-5f66-46e4-9d45-816fe550ca5c tempest-CinderUnicodeTest-1795447600 None] Lock "cinder-54221ca4-d214-4e26-97dd-062565eb53f1-delete_snapshot" released by "delete_snapshot" :: held 1.827s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:32 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-18eb8d1d-e14a-4af9-8273-f0f8a7cfb57f tempest-CinderUnicodeTest-1795447600 None] Acquiring lock "cinder-f3155a40-abaf-4ad7-a95b-ab36715a7d8d-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:32 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-18eb8d1d-e14a-4af9-8273-f0f8a7cfb57f tempest-CinderUnicodeTest-1795447600 None] Lock "cinder-f3155a40-abaf-4ad7-a95b-ab36715a7d8d-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:32 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-18eb8d1d-e14a-4af9-8273-f0f8a7cfb57f tempest-CinderUnicodeTest-1795447600 None] Acquiring lock "cinder-quobyte-f3155a40-abaf-4ad7-a95b-ab36715a7d8d" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:32 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-18eb8d1d-e14a-4af9-8273-f0f8a7cfb57f tempest-CinderUnicodeTest-1795447600 None] Lock "cinder-quobyte-f3155a40-abaf-4ad7-a95b-ab36715a7d8d" acquired by "delete_volume" :: waited 0.008s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:32 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5608b77c-7d28-4566-9808-87c1910e5e97]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:35:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-18eb8d1d-e14a-4af9-8273-f0f8a7cfb57f tempest-CinderUnicodeTest-1795447600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:32 devstack sudo[90608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d
Apr 02 10:35:32 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:32 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-18eb8d1d-e14a-4af9-8273-f0f8a7cfb57f tempest-CinderUnicodeTest-1795447600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d" returned: 0 in 0.448s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:32 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-18eb8d1d-e14a-4af9-8273-f0f8a7cfb57f tempest-CinderUnicodeTest-1795447600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:32 devstack sudo[90613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d
Apr 02 10:35:32 devstack sudo[90613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:33 devstack sudo[90613]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-18eb8d1d-e14a-4af9-8273-f0f8a7cfb57f tempest-CinderUnicodeTest-1795447600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-f3155a40-abaf-4ad7-a95b-ab36715a7d8d" returned: 0 in 0.382s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:33 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-18eb8d1d-e14a-4af9-8273-f0f8a7cfb57f tempest-CinderUnicodeTest-1795447600 None] Lock "cinder-quobyte-f3155a40-abaf-4ad7-a95b-ab36715a7d8d" released by "delete_volume" :: held 0.865s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:33 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-18eb8d1d-e14a-4af9-8273-f0f8a7cfb57f tempest-CinderUnicodeTest-1795447600 None] Created reservations ['b7701580-0a4b-4485-a8e1-14ff4adcf7e5', 'c2ef7877-8904-440d-a176-e0e7c6e56681', '28589bc8-3421-4e53-a177-280568f237ad', '46d49d75-2db9-433e-827d-f2571bac5351'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:35:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-18eb8d1d-e14a-4af9-8273-f0f8a7cfb57f tempest-CinderUnicodeTest-1795447600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-18eb8d1d-e14a-4af9-8273-f0f8a7cfb57f tempest-CinderUnicodeTest-1795447600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:33 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-18eb8d1d-e14a-4af9-8273-f0f8a7cfb57f tempest-CinderUnicodeTest-1795447600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:35:33 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-18eb8d1d-e14a-4af9-8273-f0f8a7cfb57f tempest-CinderUnicodeTest-1795447600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:35:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-18eb8d1d-e14a-4af9-8273-f0f8a7cfb57f tempest-CinderUnicodeTest-1795447600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-18eb8d1d-e14a-4af9-8273-f0f8a7cfb57f tempest-CinderUnicodeTest-1795447600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:33 devstack sudo[90616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:35:33 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:33 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-279df8e5-13d9-404c-934d-e4514da18d6f tempest-CinderUnicodeTest-1795447600 None] Acquiring lock "cinder-6864e833-edfc-491d-82c2-eccb9822b6fb-delete_volume" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:33 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-279df8e5-13d9-404c-934d-e4514da18d6f tempest-CinderUnicodeTest-1795447600 None] Lock "cinder-6864e833-edfc-491d-82c2-eccb9822b6fb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:33 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-279df8e5-13d9-404c-934d-e4514da18d6f tempest-CinderUnicodeTest-1795447600 None] Acquiring lock "cinder-quobyte-6864e833-edfc-491d-82c2-eccb9822b6fb" by "delete_volume" {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 02 10:35:33 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-279df8e5-13d9-404c-934d-e4514da18d6f tempest-CinderUnicodeTest-1795447600 None] Lock "cinder-quobyte-6864e833-edfc-491d-82c2-eccb9822b6fb" acquired by "delete_volume" :: waited 0.016s {{(pid=82102) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 02 10:35:33 devstack cinder-volume[82102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab86df6-d2bc-445d-9de9-4e9c67f9312c]: (4, 'qcow2') {{(pid=83013) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 02 10:35:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-279df8e5-13d9-404c-934d-e4514da18d6f tempest-CinderUnicodeTest-1795447600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6864e833-edfc-491d-82c2-eccb9822b6fb {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:33 devstack sudo[90618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6864e833-edfc-491d-82c2-eccb9822b6fb
Apr 02 10:35:33 devstack sudo[90618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:33 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-18eb8d1d-e14a-4af9-8273-f0f8a7cfb57f tempest-CinderUnicodeTest-1795447600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.397s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:33 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-18eb8d1d-e14a-4af9-8273-f0f8a7cfb57f tempest-CinderUnicodeTest-1795447600 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:35:33 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-18eb8d1d-e14a-4af9-8273-f0f8a7cfb57f tempest-CinderUnicodeTest-1795447600 None] Deleted volume successfully.
Apr 02 10:35:33 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-18eb8d1d-e14a-4af9-8273-f0f8a7cfb57f tempest-CinderUnicodeTest-1795447600 None] Lock "cinder-f3155a40-abaf-4ad7-a95b-ab36715a7d8d-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:33 devstack sudo[90618]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-279df8e5-13d9-404c-934d-e4514da18d6f tempest-CinderUnicodeTest-1795447600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6864e833-edfc-491d-82c2-eccb9822b6fb" returned: 0 in 0.454s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:33 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-279df8e5-13d9-404c-934d-e4514da18d6f tempest-CinderUnicodeTest-1795447600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6864e833-edfc-491d-82c2-eccb9822b6fb {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:33 devstack sudo[90624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6864e833-edfc-491d-82c2-eccb9822b6fb
Apr 02 10:35:33 devstack sudo[90624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:34 devstack sudo[90624]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-279df8e5-13d9-404c-934d-e4514da18d6f tempest-CinderUnicodeTest-1795447600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482/volume-6864e833-edfc-491d-82c2-eccb9822b6fb" returned: 0 in 0.370s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:34 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-279df8e5-13d9-404c-934d-e4514da18d6f tempest-CinderUnicodeTest-1795447600 None] Lock "cinder-quobyte-6864e833-edfc-491d-82c2-eccb9822b6fb" released by "delete_volume" :: held 0.844s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:34 devstack cinder-volume[82102]: DEBUG cinder.quota [None req-279df8e5-13d9-404c-934d-e4514da18d6f tempest-CinderUnicodeTest-1795447600 None] Created reservations ['b74930e5-6516-4f54-91a5-03708edf0436', '73c803dc-3a0f-4748-a570-f17ae0e9f1d0', 'f5c7a57f-8ac7-432c-8bed-a9e410364899', 'd060d89a-49cf-49ca-9a0e-672ee98d6de4'] {{(pid=82102) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 02 10:35:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-279df8e5-13d9-404c-934d-e4514da18d6f tempest-CinderUnicodeTest-1795447600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 02 10:35:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-279df8e5-13d9-404c-934d-e4514da18d6f tempest-CinderUnicodeTest-1795447600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 02 10:35:34 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-279df8e5-13d9-404c-934d-e4514da18d6f tempest-CinderUnicodeTest-1795447600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091': None} {{(pid=82102) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 02 10:35:34 devstack cinder-volume[82102]: DEBUG cinder.volume.drivers.quobyte [None req-279df8e5-13d9-404c-934d-e4514da18d6f tempest-CinderUnicodeTest-1795447600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5cf15c89-0bc8-40ac-bd0d-9dafa9ebe091'] {{(pid=82102) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 02 10:35:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.lockutils [None req-279df8e5-13d9-404c-934d-e4514da18d6f tempest-CinderUnicodeTest-1795447600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 02 10:35:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-279df8e5-13d9-404c-934d-e4514da18d6f tempest-CinderUnicodeTest-1795447600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482 {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 02 10:35:34 devstack sudo[90627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482
Apr 02 10:35:34 devstack sudo[90627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 02 10:35:34 devstack sudo[90627]: pam_unix(sudo:session): session closed for user root
Apr 02 10:35:34 devstack cinder-volume[82102]: DEBUG oslo_concurrency.processutils [None req-279df8e5-13d9-404c-934d-e4514da18d6f tempest-CinderUnicodeTest-1795447600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8fb115369610ccf9a43e70b43ba37482" returned: 0 in 0.419s {{(pid=82102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 02 10:35:34 devstack cinder-volume[82102]: DEBUG cinder.manager [None req-279df8e5-13d9-404c-934d-e4514da18d6f tempest-CinderUnicodeTest-1795447600 None] Notifying Schedulers of capabilities ... {{(pid=82102) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 02 10:35:34 devstack cinder-volume[82102]: INFO cinder.volume.manager [None req-279df8e5-13d9-404c-934d-e4514da18d6f tempest-CinderUnicodeTest-1795447600 None] Deleted volume successfully.
Apr 02 10:35:34 devstack cinder-volume[82102]: DEBUG cinder.coordination [None req-279df8e5-13d9-404c-934d-e4514da18d6f tempest-CinderUnicodeTest-1795447600 None] Lock "cinder-6864e833-edfc-491d-82c2-eccb9822b6fb-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=82102) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 02 10:35:44 devstack cinder-volume[82102]: DEBUG dbcounter [-] [82102] Writing DB stats cinder:INSERT=46,cinder:UPDATE=182,cinder:SELECT=121,cinder:DELETE=11 {{(pid=82102) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}